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ABSTRACT 


i 

Cse  nl  an  unproven  I (-clinical  Data  Package  in  fixed-price  production  contracts 

for  military  design  equipment  has  resulted  in  delays,  excessive  cost,  and  encouraged 
Mmy-ins^  when  TOP  deficiencies  are  subject  to  equitable  adjustment  under  the  Changes 
clause,  -p 

U-l  A procurement  technique  known  as  tpre|irnduclion  (-'valuation^  (PPK)  has  been 
developed  by  the  Army  to  avoid  the  undesirable  consequences  of  errors,  omissions, 
and  discrepancies  in  TDP’s.  ^ 

-/’’This  study  evaluates  the  use  of  the  PPF,  concept  by  major  subordinate  commands 
v'CMKC.Vfof  the  ILS.  Army  Materiel  Command  *(AWi)c\liis  study  includes  statistical  data, 
analytical  observations,  and  makes  recommendations  for  standardization  and  continued  hut 
selective  use  of  PPK. 
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EXECUTIVE  SUMMARY 

1.  Ilackground.  In  recent  years  the  Army,  Navy,  and  Air  Kone  have  developed 
separate  contract  clauses  that  transfer  responsibility  to  contractors  lor  correction  of 
errors,  omissions,  and  discrepancies  in  TDP’s.  Although  somewhat  similar  in  purpose,  the 
three  sets  of  contract  clauses  differ  significantly  in  application.  Therefore,  the  ASPIt 
committee  concluded  that  (i)  a single  clause  could  not  be  developed  to  meet  the 
requirements  of  the  three  services;  (ii)  the  clauses  were  not  deviations  from  established 
ASPR  policy;  and  (iii)  each  service  may  develop  and  use  its  own  provisions  for  transfer  of 
responsibility  for  correction  of  errors,  omissions,  and  discrepancies  in  TDP’s.  The  Army  ’s 
clause  for  this  purpose  is  entitled  “Preproduction  Evaluation”  (PPK).  AMCP  715-6  defines 
PPE  and  provides  the  basis  lor  its  use  throughout  the  procuring  activities  of  AMC. 

2.  Problem.  All  “detail  design”  TDP’s,  even  those  that  are  in  full  conformance  with 
Category  E,  MII.-D-IOOO,  will  contain  at  least  a few  errors,  omissions,  and  discrepancies. 
I se  of  even  the  best  TDP’s  have  invited  buy-ins  and  have  resulted  in  delays  and  cost 
increases  when  TDP  deficiencies  are  subsequently  corrected  for  an  equitable  adjust menl 
under  the  Changes  clause.  The  inevitable  errors,  omissions,  and  discrepancies  that  occur  in 
TDP’s  is  the  problem  which  the  PPE  concept  addresses. 

3.  Objectives.  Tlie  objectives  of  this  study  are  to  assess  (he  success  and  problems 
experienced  with  application  of  the  PPE  technique,  analyze  pitfalls  encountered  in  its 
application,  and  determine  the  desirability  of  continued  use  and  actions  necessary  by 
AMC  relative  to  standardization  of  the  PPE  concept. 

I.  Scope  and  Methods.  The  study  data  were  derived  front  replies  by  AMC.  activities 
using  PPE  To  letters  of  inquiry',  interviews  conducted  with  officials  who  participated  in 
the  formulation,  use,  and  administration  of  PPE  provisions  throughout  AMC.  ami  review 
of  all  112  known  PPE  contracts  awarded  by  major  subordinate  commands  of  AIVIC  during 
the  fiscal  years  of  1969  through  the  first  quarter  of  1973. 

5.  Conclusions  and  Recommendations. 

a.  This  study  concludes  that  PPE  is  not  generally  understood  by  personnel  of  the 
major  subordinate  commands.  It  was  found  that  there  is  considerable  disagreement  as  to 
how  or  even  if  PPE  should  be  used.  It  was  also  observed  that  there  is  a lack  of  AMC. 
guidance  on  the  projicr  use  of  PPE  and  that  local  PPE  instructions  have  evolved  with 
differing  interpretations  and  terminology  which  is  confusing  to  industry  and  Government. 
Finally,  it  is  concluded  that  it  is  desirable  to  continue  use  of  the  PPE  concept,  but  the 
concept  should  be  refined  and  improved  by  incorporating  the  recommendations  of  this 


I).  'IVn  specific  guidelines  for  belter  a||>li<a  I ion  of  ll:«*  1*1*1-  technique  an* 
recommended  by  lltix  study.  Proposed  definitions  of  compatibility  type  deficiencies  and 
oilier  basic  and  key  PPK  terms  are  included  in  Apfiendix  A to  this  study.  Plus  stmb  also 
recommends  that  several  steps  be  taken  to  provide  a belter  understanding  and  more 
consistent  application  of  the  PPK  concept.  These  steps  include  the  preparation,  review, 
and  approval  of  a standard  PPI.  clause  that  may  be  tailored  for  individual  procurements. 
A standard  PPI'.  clause  with  common  terminology  and  provisions  is  needed  to  provide  the 
framework  for  refinement  and  standardization  of  the  PI’K  concept  throughout  AW’.. 
Implementation  of  a standard  PPK  clause,  tailored  as  required,  would  require  inclusion  in 
the  AMCPI  and  a revision  to  AMCP  715-6.  Also,  on-site  training  classcs/seminars  would 
likely  be  needed  to  accompany  implementation  of  a standard  PPK  concept.  It  is  also 
recommended  that  any  standard  PPK  type  clause  be  renamed  “Compatibility  engineering 
Change  Responsibility”  (CKC.lt)  to  facilitate  a common  understanding  of  the  concept  and 
provide  a better  description  of  what  the  PPK  concept  encompasses.  Finally . it  is 
recommended  that  the  PPK  technique,  as  presently  used  or  as  it  may  be  standardized.  Ik* 
used  selectively  and  not  indiscriminately. 


- - - - - - ...  - - 
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C.HAPTKR  I 
INTRODUCTION 

A.  CKNKRAJL. 

This  study  is  concerned  with  a contractual  procedure,  known  as  Preproduction 
Evaluation  which  has  hern  used  throughout  the  Army  Materiel  Command  primarily  since 
\*)M.  The  study  is  one  element,  or  task,  within  a set  of  efforts  to  achieve  improvement  in 
the  areas  of  Technical  Data  Packages,  which  in  turn  is  one  category  among  several  within  the 
Army  Materiel  Command's  recent  project  to  achieve  Improved  Management  of  IVociircment 
and  Contracting  Techniques  (Project  IMPACT). 

PPF  type  con  tract  provisions  have  been  revised  and  refined  in  various  ways  since  almul 
lOfiS.  AMC  guidance  for  use  of  the  procedure  has  lieen  essentially  limited  to  the 
information  and  sample  clauses  contained  in  AMCP  715-6.  Within  the  framework  of  the 
pamphlet,  MSC’s  have  developed  their  own  provisions,  with  differing  sets  of  specific 
pr«H-edures  tailored  to  accommodate  local  needs  and  interpretations. 

It.  UACKCRODND. 

In  recent  years  the  Departments  of  the  Air  Force,  Navy,  and  Army  have  developed  and 
used  contract  clauses  entitled  respectively,  Total  System  Performance  Responsibility 
(TSPR),  Total  System  Responsibility  (TSR),and  Preproduction  Kvoluation  (PPF).  All  three 
sets  of  contract  provisions  attempt  to  allocate  portions  of  responsibility  to  contractors  for 
errors,  omissions,  anil  discrepancies  in  technical  data.  TSPR  and  TSR  clauses  address  the 
acquisition  and  use  of  adequate  technical  requirements  throughout  the  development, 
prcproduelion  prototype,  initial  production,  and  follow-on  prod uction  phases  of  the 
materiel  life  cycle  for  major  systems  procurements.  Where  the  contractor  participates  in 
development  of  the  requirements  or  has  an  opportunity  to  review  and  revise  or  refine  the 
technical  requirements,  it  is  fell  that  a greater  degree  of  responsibility  can  be  lairly 
transferred.  The  Department  of  the  Army’s  PPF  provisions,  on  the  other  hand,  are  primarily 
focused  toward  procurements  of  items  and  equipments  in  the  production  phase  where  the 
fiovemmenl  already  has  possession  of  adequate  technical  requirements  meeting  the 
characteristics  of  a Category  K,  MII.-D-IOOO  TDP.  In  cases  where  PPF  is  applicalde,  the  I Dl 
should  permit  identical  reproduction  hy  a competent  manufacturer  without  additional 
development  and  without  recourse  to  the  developer.  Additionally,  it  is  presupposed  that  the 
primary  goal  would  be  more  effective  attainment  and  realization  of  the  benefits  of  shilling 
to  a competitively  selected  source  of  supply.  Therefore,  while  similar  in  intent  the  three  sets 
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of  provision*  differ  significantly  in  practice.  Alter  lengthy  evaluation  of  combining  the 
substance  of  the  three  clauses,  the  ASCII  coniniitlee  concluded  to  the  effect  that: 

(i)  single  uniform  provisions  would  not  suffice  to  meet  the  myriad  possible  contractual 
relationships  of  all  three  services;  (ii)  the  provisions  were  not  deemed  to  he  deviations 
from  the  established  ASCII  policy;  and  (iii)  each  service  should  continue,  if  they  so 
desired,  to  utilize  their  own  provisions  for  the  allocation  of  responsibility  for  errors, 
omissions,  and  discrepancies  in  technical  requirements.  ^ 

C.  IH-.HINITIONS. 

1.  Creproduction  I1'. valuation.  For  the  purpose  of  this  study,  the  term  CCK  is 
interpreteil  to  be  a technique  used  in  selected  fixed-price  type  production  contracts  for 

military  design  equipment  which  incorporates  special  exculpatory  provisions  to  accomplish  < 

the  following  functions: 

a.  Acknowledge,  rather  than  deny  hy  implication,  the  potential  existence  of  ; 

TI)C  defects. 

b.  Charge  the  contractor  to  lie  responsible  for  the  risks  associated  with  selected 
types  of  TOP  defects. 

c.  Charge  the  contractor  to  evaluate  the  Tl)l‘  throughout  contract  performance 
and  identify  and  correct  the  selected  types  of  defect*  by  submissions  of  relevant  engineering 
change  proposal*  (KCPs)  and  implementation  of  approved  I'.CP’s. 

d.  Ask  prospective  contractors,  liefore  contract  award,  to  preprice  the  estimated 
work  and  risks  associated  with  the  potential  selected  TDP  defects  so  that  adjustments  of  the 
established  contract  prices  and  delivery  schedules  will  he  unnecessary  after  contract  award. 

The  PPE  procedure  for  employing  exculpatory  language  in  production  contracts  is 
explained  by  the  A MOP  715-6  dated  May  1970,  entitled  “Preproduclion  Evaluation 
Contracts.”  The  reader  is  encouraged  to  examine  the  pamphlet  to  form  the  basis  for  a belter 
understanding  of  the  analysis  contained  in  this  study. 

2.  Other  ftasic  I'I'K,  Terms.  The  definitions  of  other  basic  terms  are  contained  in 
Appendix  A which  should  he  of  particular  benefit  to  those  readers  who  are  not  familiar  with 
those  terms  that  are  basic  to  an  underatanding  of  the  PPK  concept. 
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I).  PtRPOSK  FOR  ijlSINCi  PI*!1',  PROVISIONS. 

Tlii*  main  purpose  lor  using  PPK  is  to  prevent  undue  delays  and  excessive  costs  in  the 
use  of  an  isiproven  TDK.  Prior  to  the  use  of  FW,  all  TI)P  deficiencies  were  subject  to  equitable 
adjustment  (price  ami  delivery)  under  the  standard  Changes  clause.  However,  recourse  to  the 
Changes  clause  produced  the  following  undesirable  consequences: 

1 . It  encouraged  buy-ins  and  offers  from  incapable  firms. 

2.  It  fostered  untimely  and  ineffective  identification  ami  correction  of  Technical 
Data  Package  deficiencies,  i.e.,  it  has: 

a.  Induced  a sense  of  disregard  for  llie  cost  consequences  of  TI)P  deficiencies, 
h.  Permitted  near  apathy  relative  to  specified  delivery  schedules. 

I).  Itred  uncooperative  attitudes  on  the  parts  of  both  (Government  and  industry. 

K„  OBIhC.TIVKS. 

The  general  objectives  of  this  study  are  to  assess  the  degree  of  success  experienced  with 
applications  of  the  PPK  technique,  analyze  pitfalls  encountered  in  application,  and 
determine  the  overall  desirability  of  continued  use  within  AMC  and  actions  necessary  hy 
AVf.  relative  to  standardization  of  the  PPK  concept. 

F.  MKTHOnOLOGY. 

The  study  data  were  derived  from  (i)  replies  to  a Idler  of  inquiry  sent  to  many  of  the 
relevant  organizations  within  AMC.,  a copy  of  which  is  contained  in  Appendix  It; 
(ii>  interviews  conducted  with  officials  who  participated  in  the  formulation,  use.  and 
administration  of  the  PIT.  provisions  throughout  the  AMC.  complex;  and  (iii)  review  and 
analyses  of  the  relevant  literature  and  contract  files.  The  sample  size  of  112  conlrarls 
constituted  all  known  contracts  at  the  time  of  inquiry  (Fall  1972)  which  contained  PIT. 
provisions. 

Throughout  the  analyses  of  this  study,  AMC.P  7l.ri-6  has  served  as  the  frame  of 
reference  or  baseline  for  observations  and  comparisons  of  the  PIT',  concept.  Interpretations 
hy  the  authors  were  necessary  to  identify  the  fundamental  guidelines  of  the  PPK  theory  due 
to  differing  methods  of  implementation  hy  the  several  organizations. 
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Much  of  (lie  data  and  examples  presented  in  lliis  study  are  not  lied  hack  to  the  major 
subordinate  commands.  A degree  of  anonymity  was  considered  advisable  since  the  ultimate 
objective  of  this  study  encompasses  the  desirahilil y of  continued  use  of  the  PPF  technique 
and  not  its  specific  application. 

C.  ORGANIZATION  OF  RKPORT. 

The  remainder  of  this  report  is  framed  within  the  project  objectives.  The  underlying 
theory  of  PPF  ami  its  application  within  AVC  are  explained  in  Chapters  II  and  III, 
respectively.  Chapter  IV  analyzes  the  (trohlems  encountered  in  PPF.  application.  Chapter  V 
establishes  the  guidelines  for  improved  application  and  standardization  of  the  technique. 

And  Chapter  VI  presents  the  summary,  conclusions,  and  recommendations. 
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CHAPTKK  II 

TIIKOKY  AND  POLICY  ON  PPK  l IS  AIM. 

A.  GF.NK.HAL. 

flasir  lo  an  understanding  of  llir  theory  behind  PPL  is  the  general  problem  of  errors 
and  omissions  in  the  TUP'S  prepare<l  for  reprocurement  purposes.  While  it  is  desirous  Ilia) 

Tltrs  Ih>  adequate,  eurrenl,  elear,  accurate,  and  complete,  it  is  known  that  they  will  contain 
errors  and  omissions.  This  chapter  summarizes  some  of  the  inherent  reasons  for  such  TDP 
errors  and  omissions  and  includes  a conceptual  view  of  PPL  as  implemented  throughout 

AIHC. 

It:  TDP  DFKIGIFNCIFS. 
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1.  The  Reasons  for  TDP  Deficiencies.  AMC  Regulation  70-46  provides  that  TDP's 
for  effecting  competitive  production  contracts  are  to  be  adequate,  current,  clear,  accurate, 
and  complete.  Yet  past  experience  provides  ample  evidence  that  even  very  high  quality 
TDP's  in  fact  do  not  fully  comply  with  those  descriptors.  In  complex  procurements  the 
individual  data  elements  number  in  the  thousands,  tens  of  thousands  and  even  hundreds  of 
thousands,  and  it  is  not  surprising  that:  (i)  most,  if  not  all,  TDP’s  fall  somewhat  short  of 
the  desired  goals  due  to'  the  human  element  involved  and  the  effect  of  the  law  of 
diminishing  returns  when  attempts  are  made  to  perfect  the  TDP;  and  (ii)  various 
production  contractors  perceive  the  TDP  differently  than  Government  personnel  with 
regard  to  the  desired  goals.  The  reasons  for  the  deficiencies  stem  from  the  preparation  of  the 
TDP’s  as  well  as  from  the  way  they  are  interpreted  by  contractors  who  are  not  familiar  with 
the  TDP’s.  The  reasons  for  TDP  deficiencies  can  lie  categorized  in  terms  of  the  opposites  to 
the  stated  goals  of  AMGR  7046;  that  is,  while  the  technical  data  package  should  he 
adequate,  current,  clear,  accurate,  and  complete,  it  is  known  that  in  some  respects  it  will  lie 
inadequate,  outdated,  discrepant,  and  that  it  will  contain  errors  and  omissions. 

2.  The  Reason  for  Acknowledgment  of  TDP  Deficiencies.  In  past  “non-PPF  type” 
proc  urement  actions,  many  Government  personnel  felt  that  the  natural  imperfection  of  the 
TDP  would  he  implied  as  contracts  were  effected  and  that  assumptions  of  responsihilil y by 
the  contractor  would  naturally  follow.  Itut  as  differences  of  opinion  have  arisen  after 
contract  award,  the  implication  over  the  years  has  been  held  to  be  the  opposite  during 
numerous  litigations  including  the  implied  warranty  doctrine  first  established  in  the  case  of 
Sperrin  vs.  United  Stales  in  1918  and  more  recently  in  the  case  of  II RDM  vs.  United  Stales 
in  1966.  Since  TDP  deficiencies  are  expected  to  exist,  and  in  view  of  the  implied  warranty 
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doctrine,  it'  the  (Government  desire*  to  have  the  conlraetor  correct  the  deficiencies,  a*  i >art 
of  the  scope  of  work,  without  repetitive  eontracl  adjustments.  it  is  necessary  that  the 
(Government  acknowledge  the  deficiencies  before  contract  award. 

•t.  Ty  [<e*  of  TIH*  Deficiencies  ’(Teat  hall  Within  the  PPI  Concept.  AKKJ1  715-6 
uses  the  word  “compatibility’’  to  define  the  deficiencies  that  are  to  Ik?  corrected  bv  the 
contractor  as  part  of  his  scope  of  work  under  a PPK  contract.  The  word  compatibility 
emanates  from  ISTIL-STD-480  and  as  used  in  the  various  PPK  provisions  refers  to  Code  A. 

and  some  of  Code  I)  deficiencies  as  defined  therein.  It  is  suggested  that  the  reader  refer 
to  AMO'  715-6,  page  11-2  and  Appendix  A of  this  study  for  more  comprehensive 
definitions  of  a compatibility  change  and  its  relationship  to  Ml  I, -STD -180.  Compatibility 
most  nearly  describes  the  types  of  deficiencies  encompassed  by  the  PPK  concept  and  has 
been  adopted  for  use  as  a descriptive  tool  by  all  of  the  major  subordinate  commands. 
Table  II- 1 categorizes  the  names  currently  assigned  to  what  this  study  calls  Compatibility 
engineering  Change  Proposals  (CKCP’s)  which  are  KCP's  submitted  by  contractors  to 
correct  Compatibility  Deficiency  (CD's).  (See  Appendix  A for  a definition  of  CD's.)  At 
the  very  least  such  differences  may  be  confusing  and  misleading  to  both  Covernmenl 
personnel  and  industrial  firms— especially  those  who  have  many  contracts  with,  PPK 
provisions. 

( ..  KXPKCTATIONS  OK  PPK  CONCEPT. 

The  major  expectations  of  the  PPK  concept  are  centered  around  the  purpose  for 
PPK,  i.e.,  to  prevent  undue  delays  and  excessive  cost  in  the  use  of  an  unproven  TOP.  To 
the  extent  that  the  foregoing  benefits  are  achieved  one  would  expect  (bat  requests  for 
contract  adjustment  (price  and/or  delivery)  would  be  few,  rather  than  many,  will:  valid, 
rather  than  questionable  bases.  Also  any  requests  for  prire  adjustment  would  he  limited 
lo  few,  if  any,  situations  where  ihe  contractors  sincerely  believed  that  the  definition  of 
what  constituted  a compatibility  deficiency  has  beer  exceeded.  Furthermore  any 
requests  for  delivery  extension  would  be  accompanied  by  consideration  to  the 
(Government,  or  at  least  plausible  justification  would  be  provided  in  supj'ort  of  the 
consideration  offered. 


TABLF,  II  I:  NAMKS  F.MPLOYFI)  FOR  COMPATIBILITY  FNCINECRING 
CIIANC.F.  I'BOPOSALS* 


Major  Subordinate 
Command 

Name  F.mployed  for  OF, CP’s 

F.COM 

Compatibility  Change  F.OP’s  and  Production 

1'  valuation  Compatibility  Change  (PF.CC)  FCP’a 

MF.COM 

t ategory  II  I’.CP’a 

MICOM 

(Allegory  II  KCP*a,  Category  A F.CP’s,  and 
Category  II  F.CP’a* 

MI'ICOM 

Frankford  A 

Category  II  FCP*s 

. 

Picatinny  A 

Class  II  Cep’s,  PPF,  Change,  and  Category  II 
Cep’s** 

TACOM 

IVeprinludion  1 'valuation  IVopoKak  (ITKPa) 

WFCOV 

lYeproduction  evaluation  lYoposals  (I’PF.P’s) 

•Study  data  wan  obtained  during  Fall  of  1972  and  before  rcorgnnizalion/combinalion  of 
MSC’s. 

**  Latest  usage. 

I>.  POLICY  ON  PPF.  USAGE  IN  AM C. 

The  primary  aource  of  policy  guidance  for  the  PPF,  procedure  baa  been  eaaentiallv 
limited  to  the  conceptual  diacuaaioiM  and  aamplc  clauaea  contained  within  AMCP  715-6. 
Based  on  thia  pamphlet,  many  MS(?a  have  developed  their  own  PPF,  guidance  document  a 
which  are  identified  in  the  following  Table  11-2. 
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Table  II  2:  PPF, GUIDANCF,  DOCUMENTS  ISSURD  TO  SIIPPI.RMRNT  AMCP  715-6* 


Vajor  Subordinate 
Command 

(Guidance  Document* 

FCOIVf 

IMPI  .‘1.7-69  dated  5 December  I960  {this  update; 
Production  engineering  IVoccdurc  No.  95  dated 

2.7  August  1971;  Production  engineering  Procedure 

No.  CM-I  dated  6 February  1977;  DF,  AMSF.I.-PP  PP, 
dated  2 March  1977,  Subject:  PPF,  Contract  Special 
Provisions. 

VI  COM 

IP  Instruction  15-72  dated  14  June  1972. 

MDCOM 

I rank  ford  A 

F'A  Regulation  715-78  dated  7 December  1970. 

Picatinny  A 

PA/II1SA  Regulation  70-25  dated  9 August  1972. 

TACOM 

Draft  TACOM  Pamphlet  on  PPF,  and  Offeror’s  Guide 
for  F.valualion  of  PPF.  change  proposals. 

WF.COM 

AWC  Procurement  Instruction  4-5200  and  letter 
dated  28  October  1970. 

♦Most  of  flic  study  data  watt  obtained  during  Fall  of  1972  and  before 
reorganizalion/comhination  of  MSC’s. 


Although  the  aliove  identified  MSC’s  have  supplemented  AMCP  715-6  with  their  own 
local  instructions,  the  existence  of  a PPF.  peculiar  instruction  was  not  observed  at  the  other 
organizations  where  the  PPF.  technique  has  not  been  used.  Kvidence  indicates  that  PPF. 
guidance  front  an  AMC.  point  of  view,  is  fragmented,  inconsistent,  not  comprehensive,  and  is 
sometimes  contrary  in  important  areas.  In  some  cases  the  local  instructions  were  apparently 
generated  from  the  engineering  side  of  the  MSC*s  and  from  the  procurement  side  in  other 
cases.  All  of  the  PPF.  instructions  have  been  pioneering  in  nature,  especially  AMCP  715-6. 
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The  1*1*1'’.  technique  represents  a significant  ami  complex  departure  from  practices  of  the  pox  I 
and  instructions  concerning  its  application  are  understandably  controversial  and  less  than 
perfeet  until  refinements  are  effected.  At  present  it  should  lie  pointed  out  that  l*l*K 
implementation  procedure*  do  differ  throughout  AMC  with  respect  to  terminology 
employed,  methods  of  pricing,  goals,  areas  of  applicability,  responsibilities  for  initiation  of 
the  necessary  actions,  classification  of  compatibility  change  schemes,  and  in  numerous  other 
ways. 

The  problems  resulting  from  inconsistent  policy  in  the  application  of  1*1*1-'  will  become 
apparent  in  the  following  chapters  which  review  the  application  of  the  technique 
throughout  AMC.. 
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CHAPTER.  Ill 

OIISF.R  V ATIONS  ON  PPE  APPLICATION  THROUGHOUT  AMC 
A.  CKNKRAL. 


This  chapter  addresses  the  implementation  and  actual  hr  ago  of  the  PPK  technique  hy 
MSC’s  and  provides  statistical  information  and  observations  concerning  the  use  of  PPK  prior 
to  contract  award  (Procurement  Solicitation  Phase)  and  after  contract  award  (Contract 
Administration  Phase). 

B.  PROCUREMENT  SOLICITATION  PHASE. 

| . Types  of  Solicitation  Employed  with  PPE  Provisions.  A total  of  1 12  contracts  at 
the  MSC’s  representing  the  total  population  of  contracts  with  PPE  provisions  that  were  in 
existence  within  AMO  were  analyzed  during  this  study.  Table  lll-l  depicts  the  types  of 
solicitations  that  resulted  in  the  award  of  these  112  contracts.  It  is  interesting  to  note  the 
diversity  of  solicitation  types  used.  Perhaps  this  indicates  that  PPK  may  be  used  with  any 
method  of  solicitation  and  that  which  fits  best  should  be  utilized.  However,  some  qualifying 
observations  concerning  the  use  of  the  PPE  concept  diving  the  solicitation  phase  are  set 
forth  below. 


TABLE  HI-1 : TYPES  OF  SOLICITATIONS  EMPLOYED  WITH  PPF,  PROVISIONS 


Major 

Subordinate 

Number  ol 

F Contract! 

i hy  Solicitation ' 

Command* 

IFB 

RFP 

RFQ 

2 Step  IFB 

Total  Observed 

Command  A 

12 

__ 

14 

Command  R 

3 

1 

4 

11 

Command  C 

2 

— 

— 

6 

Command  1) 

1 

2 

1 

— 

4 

Command  F. 

— 

— 

2 

2 

Command  F 

56 

17 

1 

1 

75 

AMC  TOTAL 

66 

36 

I 

3 

7 

. j 

112 

•Specific  MSC’s  not  identified  for  purposes  of  this  study. 
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2.  Observations  on  Use  of  PPE  During  Solicitation  Phase. 

i.  Invitation  for  Bids  (IFB*s)  (Other  than  two-step  IFIfi).  AM  CP  715-6 
advises  against  use  of  the  IFB’s  type,  yet,  66  IFIPs  were  observed.  Some  personnel 
interviewed  expressed  surprise  upon  learning  that  IFB’s  had  been  issued  with  PPE 
provisions.  The  analysts  were  also  surprised  to  find  such  a high  incidence  of  IFR’s.  There 
seems  to  he  a contradition  in  issuing  an  IFR  with  PPE  provisions  since  (i)  firmness  of 
specifications  is  one  of  the  primary  requisites  for  use  of  formal  advertising;  and  (ii)  use  of 
PPE  provisions  by  definition,  constitutes  an  express  acknowledgment  of  the  absence  of  firm 
specifications,  even  though  the  relative  magnitude  of  unfirmness  is  not  addressed.  Where 
there  is  an  unfirmness  condition,  it  would  seem  appropriate  to  inform  prospective 
contractors  (i)  that  a low  quality  TDP  was  involved;  (ii)  that  significant  departures  from 
the  TDP  might  be  necessary  to  overcome  the  deficiencies  and  to  achieve  stated 
manufacturing  and  equipment  performance  objectives;  and/or  (iii)  that  substantial 
development  effort  may  be  necessary  relative  to  certain  portions  of  the  product  design.  In 
these  cases,  the  implication  that  the  TDP  was  firm,  by  virtue  of  employing  formal 
advertising  techniques,  would  seem  to  be  quite  improper  and  unfair.  In  at  least  one  case 
(without  PPE)  the  ASBC.A  was  asked  to  rule  relative  to  the  magnitude  of  risk  which  had 
flowed  to  the  contractor,  and  in  this  case,  the  solicitation  type  was  one  of  the  critical 
considerations.  The  set  of  considerations  is  indicated  in  the  following  excerpt: 

. . . that  such  a shift  of  risk  was  not  intended  is  indicated 
by  the  fact  that: 


(1)  the  design  drawings  were  familiar  and  prepared  by  the 
Government; 

(2)  the  contract  was  formally  advertised  and  awarded  as  a 
production  contract  rather  than  as  a research  and 
development  contract; 

(3)  there  is  no  provision  for  the  specifications  to  take 
precedence  over  the  drawings; 

(4)  there  is  no  express  provision  requiring  contractors  to 

make  design  changes  needed  to  meet  performance 
requirements;  and  / 


(5)  the  contract  contains  the  standard  “Changes"  clause 
(which  courts  will  not  allow  to  be  deprived  of  its  ordinary 
coverage  without  express  contract  provisions  calling  for  that 
result^ 
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F.ven  though  nonconclusive,  another  indicator  was  observed  from  the  findings  of  a recent 
study  of  some  of  Command  F’s  procurements  wherein  it  was  reported  that  out  of  19  claims 
submitted  during  a particular  span  of  time,  15  were  against  contracts  awarded  after  IFR 
solicitations. ^ Therefore,  it  appears  reasonable  that  use  of  the  IFR  technique  would  not 
contribute  to  a better  understanding  concerning  the  amount  of  risk  to  be  transferred.  The 
IFR  solicitation  does  not  encourage  dialogue  and  is  not  considered  to  be  an  effective 
method  for  communication  of  the  relative  magnitude  of  specification  firmness. 

b.  Requests  for  Proposals  (RFP*s).  Negotiated  procurements,  on  the  other 
hand,  solicited  by  use  of  Requests  for  Proposals  provided  a better  opportunity  for  extensive 
two-way  communication  about  the  procurement  history  of  the  item,  the  current  status  of 
the  TDP  as  a production  baseline,  the  nature  and  extent  of  coverage  of  the  PPE  transfer  of 
responsibilities,  and  the  contractor’s  intended  role.  Thirty-six  out  of  the  112  contracts 
observed  were  effected  by  RFP  solicitations.  It  is  important  to  note  (i)  most  of  the 
contracts  observed  at  Command  A were  effected  by  RFFs;  (ii)  of  the  1 7 RF'Fs  observed 
at  Command  F,  most  were  initial  production  contracts  where  subsequent  production 
problems  were  expected;  and  (iii)  of  the  seven  RFFs  at  Commands  R,  C,  and  D,  it 
appeared  that  a need  for  extensive  communication  was  anticipated. 

c.  Requests  for  Quotations  (RFQ’s).  RFQ’s  are  not  extensively  used  by  MSC’s 
of  AMC.  Although  the  inclusion  of  PPE  provisions  in  an  RFQ  may  be  appropriate, 
observations  will  not  be  made  since  the  uw  of  RFQ’s  is  necessitated  by  factors  outside  the 
direct  subject  matter  of  PPE. 

d.  Two-Step  Formal  Advertising.  The  use  of  Two-Step  Formal  Advertising 
solicitations  with  PPF,  provisions,  illustrated  a positive  and  deliberate  attempt  to  assure 
effective  two-way  communication  and  mutual  understanding  of  the  pertinent  aspects  of  the 
history  and  status  of  the  TDP,  the  peculiarities  of  the  PPF.  concept,  and  the  intended 
contractual  relationship.  During  the  first  step,  at  Commands  R and  F.,  prospective 
contractors  were  asked  to  evaluate  the  TDP  in  considerable  detail  and  to  submit  sample  PPF'. 
submissions  of  compatibility  type  engineering  change  proposals.  This  provided  the 
Government  an  opportunity  to  draw  some  conclusions  about  the  prospective  contractors' 
level  of  understanding  and  to  clarify  misconceptions  prior  to  soliciting  price  proposals.  The 
PPE  provisions,  however,  were  only  one  of  the  peculiar  or  unique  circumstances  which 
justified  use  of  the  Two-Step  IFR  approach;  and  the  approach  would  be  unnecessary 
without  other  justification  factors,  unless  of  course  the  procuring  activity  considered  it  to 
be  the  only  way  to  effect  the  necessary  level  of  dialogue. 
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e.  Employment  of  Other  Communicative  Techniques  During  the  Solicitation 
Phase.  The  asserted  purpose  for  employing  other  communicative  techniques  during  the 
solicitation  phase  is  to  supplement  that  which  can  he  achieved  via  the  selected  solicitation 
method  to  assure  understanding  about  the  peculiarities  of:  (i)  the  PPF  concept  and 
specific  PPF.  provisions;  (ii)  the  individual  procurement  action  and  relevant  status  of  the 
TPP;  and  (iii)  the  magnitude  of  the  risks  intended  to  flow  to  the  production  contractor. 

From  an  overview,  it  is  observed  that  the  following  six  techniques  were  employed  to  achieve 

this  purpose:  (i)  solicitation  of  technical  proposals;  (ii)  presolicitation  conferences;  J 

(iii)  post  award  conferences;  (iv)  allowances  for  extra  lead  time  to  review  the  TDP; 

(v)  in-depth  pre-award  surveys  with  emphasis  on  PPE;  and  (vi)  use  of  a special  letter  or 
certificate  of  understanding  to  be  signed  by  the  contractor  at  contract  inception. 

Observations  about  each  of  these  techniques  will  now  be  briefly  addressed. 

(1)  Solicitation  of  Technical  Proposals.  This  technique  was  employed  on 
a limited  number  of  solicitations  at  Commands  A and  C to  supplement  price  proposals.  It 
was  not  observed  in  solicitations  at  Commands  D and  F.  The  Two-Step  IFR  solicitations  at 
Commands  H and  F.  by  definition  included  technical  proposals  as  well  as  price  proposals. 

The  effectiveness  of  this  technique  is  didiious.  For  example,  in  one  solicitation  two 
technical  proposals  were  received.  One  offeror’s  technical  proposal  adequately  covered  the 
conception  of  PPF.  and  provided  a plan  for  conducting  the  PPF.  work,  while  the  other 
offeror's  technical  proposal  did  not  mention  PPE.  The  latter  offeror  apparently  had  either 
discounted  the  significance  of  the  concept  or  had  misunderstood  it.  It  may  be  concluded 
that  unless  technical  proposals  are  otherwise  required,  the  necessary  exchange  of  PPF, 
information  can  be  effected  equally  well  with  or  without  a technical  proposal.  This  is  true 
because  in  most  cases  a face-to-face  exchange  of  information  is  required  to  achieve  mutual 
understanding.  However,  the  use  of  technical  proposals  where  otherwise  justified  seems  to 
provide  a very  convenient  method  for  an  in-depth  exchange  of  information,  most  of  which 
could  be  in  writing  to  serve  as  a back-up  document  to  the  contract. 

(2)  Presolicitation  Conferences.  Presolicitation  conferences  are 
expensive,  time  consuming,  and  may  confuse  rather  than  inform.  However,  when  needed, 
they  have  provided  an  excellent  forum  to  achieve  the  three  previously  listed  communication 
goals.  AMCP  715-6  gives  an  exemplary  example  of  a PPF,  speech,  which  was  used  by 
Frankford  Arsenal  and  Ptcatinny  Arsenal  in  several  procurements.'^  Commands  A and  C use 
the  presolicitation  conference  technique  in  most  of  their  PPF,  solicitations;  Commands  R 
and  F.  either  already  use  it  or  state  that  they  probably  will  use  it  except  when  the  Two-Step 
IFR  solicitation  is  used.  Command  F conducted  a few  presolicitation  conferences  during 
their  PPF.  trial  period,  but  quit  after  it  was  felt  that  industry  had  become  accustomed  to 
PPE.  Most  of  Command  Ps  contracts,  therefore,  were  not  affected  after  a presolicitation 
conference.  Even  if  industry  is  acquainted  with  the  PPE  concept,  as  employed  by  Command 
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F,  it  is  questioned  how  relevant  information  about  the  TOP  status,  procurement  history, 
and  intended  exclusions  and  inclusions  of  responsibility  were  communicated  so  that  mutual 
understanding  could  be  effected  about  the  magnitude  of  risk  to  be  assumed.  To  expound  on 
this  area  of  concern,  at  Command  A (where  presolicitalion  conferences  were  held)  one  of 
the  main  topics  of  the  conferences  was  whether  specified  performance  levels  had  been  met 
(including  examination  of  some  of  the  available  corroborating  evidence),  and  to  what  extent 
a contractor  would  he  responsible  for  performance  levels  not  previously  attained. 
Admittedly,  a tendency  of  the  Government  personnel  at  such  conferences  was  to  make 
assertions  that  sometimes  exceeded  the  facts,  especially  when  the  item  was  type  classified. 
Also  this  tendency  has  apparently  caused  problems  at  Command  A.  Rut  the  questions  are: 
Does  not  Command  F experience  similar  situations?  If  so,  how  does  the  information  flow  to 
the  prospective  contractors?  Even  though  highly  subjective,  the  general  assessment  was  that 
the  information  was  often  not  communicated. 

(3)  Poet  Award  Conferences.  Although  not  occurring  during  the 
procurement  solicitation  phase,  it  is  deemed  appropriate  to  mention  that  Command  F has 
utilized  post  award  conferences  between  PCO  representatives  and  the  selected  contractor. 
One  of  the  subjects  discussed  at  many  such  conferences  was  the  PPE  technique.  While  the 
analysts  do  not  take  issue  with  having  such  conferences  when  otherwise  needed,  it  does 
seem  unwise  that  significant  communication  concerning  PPF.  responsibilities  took  place 
subsequent  to  rather  than  prior  to  award.  In  one  instance,  during  a poet  award  conference 
the  contractor  obviously  needed  extensive  clarification  concerning  the  “type"  deficiency 
that  would  be  processed  under  the  Changes  clause.  In  another  instance,  the  contractor  was 
surprised  at  the  magnitude  of  risk.  He  stated  that  he  could  not  proceed  with  the  contract  in 
view  of  the  new  knowledge  gained  during  the  post  award  conference.  Numerous  other 
similar  situations  were  observed  and  each  time  the  relevant  question  seemed  to  be,  “Isn't  it 
too  late  to  be  discussing  these  matters?" 

(4)  Allowances  for  Extra  “On  the  Street"  l^ad  Time.  AMCP  715-6 
suggests  that  “longer  than  normal"  solicitation  lead  time  should  be  provided  when  PPE 
provisions  are  used.  If  30  days  are  considered  “normal,"  probably  a minimum  of  45  or 
preferably  60  or  more  days  should  be  allowed  with  PPE.  The  inferred  purpose  for  the  extra 
lead  time  allowance  is  not  to  identify  defects  during  the  pre-award  phase,  but  rather  to 
encourage  a thorough  review  to  attain  maximum  awareness  and  appreciation  of  (i)  the 
particular  nature  of  the  TDP;  (ii)  the  associated  problems;  and  (iii)  the  amount  of  risk  to 
be  assumed  under  the  stringent  PPE  provisions.  Without  proper  assessment  of  the  amount  of 
risk,  a prospective  contractor  may  be  unable  to  financially  strvive  if  selected  for  award.  At 
least  the  success  of  such  a contract  would  be  doiditful.  In  general,  several  meaningful  points 
were  apparent,  as  follows: 
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(a)  Commands  It  and  K use  of  Two-Step  IFffs  provided  what 
appeared  to  be  ample  “TDI*  review  time.”  Furthermore,  the  sample  submissions  of 
compatibility  type  engineering  change  proposals  provided  a two-way  exchange  of 
information  during  the  critical  solicitation  phase.  Under  these  procedures,  a competent 
prospective  contractor  could  hardly  avoid  the  requisite  TI)P  review.  Also  it  is  almost  certain 
that  he  would  become  apprised  of  the  general  magnitude  of  the  risk  involved. 

(b)  Similarly,  in  most  of  the  RFP’s  employed  both  with  and  without 
technical  proposals,  45  days  solicitation  time  was  observed  and  in  several  cases  60,  75,  and 
even  90  days  were  allowed. 

(c)  When  IFR’s  were  user  I,  however,  a standard  response  time  of  50 
days  was  provided  for  review  of  the  TOP.  Not  infrequently  the  bid  opening  dates  were 
extended  from  30  days  to  40  or  45  days  or  longer,  but  prospective  contractors  had  to 
request  the  extension  and  provide  justification.  At  Command  F,  several  individuals 
concurred  with  the  need  for  longer  than  normal  response  time  with  PPF.  However,  since 
time  extensions  were  normally  requested  and  granted,  an  initial  allowance  longer  than  30 
days  was  not  considered  necessary. 

(d)  Many  letters  from  industry,  prepared  both  prior  to  and  after 
award,  were  observed  wherein  complaints  were  expressed  that  the  allowable  lead  time  was 
too  short  for  a realistic  review  of  the  TDP.  Such  complaints  are  almost  commonplace 
occurrences  and  are  expected  in  some  cases.  Itut  the  tone  of  several  complaints  took  on  a 
new  and  different  significance  vis-a-vis  the  PPF  shift  of  responsibility.  The  observation  is 
that  when  the  Government  utilizes  the  PPF,  provisions,  a savings  of  a few  days  “on  the 
street”  review  time  may  be  very  costly  and  counterproductive.  The  following  excerpt 
regarding  a contract  Htigstion  while  not  directly  related  to  PPF,,  nevertheless  seems  relevant 
to  the  lead  time  issue  when  PPF.  provisions  are  employed: 

A bidder’s  duty,  by  contrast,  must  be  measured  by  the 
pressures  of  time  and  competition— not  in  the  calm 
meditation  of  hindsight.  There  are  limits  to  the  amount  of 
study  he  must  do  to  determine  the  Government’s 
requirements.^ 

(5)  Conduct  of  Pre- award  Surveys.  The  main  function  of  the  pre-award 
survey  is  to  determine  a prospective  contractor’s  capability  to  perform  a proposed  contract. 
Hut  it  can  also  serve  to  clarify  and  emphasize  key  aspects  of  a procurement  including  PPF. 
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provisions.  Both  functions  were  performed  in  many  of  tlie  observed  cases  hut  were  not 
performed  in  others.  The  pertinent  general  observations  concerning  the  coverage  of  PPF, 
provisions  during  a pre-award  survey  are  as  follows: 


f 


(a)  In  approximately  25  percent  of  the  contracts,  considerable 
emphasis  was  placed  during  pre-award  surveys  on  the  transfer  of  responsibility  under  PPF, 
provisions.  The  quest  was  twofold:  (i)  to  measure  the  capability  of  the  prospective 
contractor;  and  (ii)  to  assess  whether  he  understood  the  procurement  action,  the  PPF, 
concept  and  the  risks  to  be  assumed.  In  most,  if  not  all,  of  these  cases  the  PC.O  was 
represented  in  the  pre-award  sinveys. 

(b)  In  at  least  20  percent  of  the  contracts,  the  evidence  indicated  that 
special  PPF,  emphasis  did  not  occur  during  pre-award  surveys. 

(c)  In  the  remaining  55  percent  of  the  contracts  it  was  impossible  to 
determine  whether  special  PPF,  emphasis  did  or  did  not  occur. 

During  review  of  the  above  contracts  it  was  observed  in  the  case  of 
Command  F that  the  pre-award  survey  team  did  not  have  PC.O  representation.  This  created  a 
problem  because  DCAS  personnel  were  generally  not  sufficiently  familiar  with  the  PPF, 
approach  to  effectively  emphasize  its  unique  aspects  to  prospective  contractors.  However, 
intensive  and  impressive  analyses  were  conducted  during  a few  of  the  pre-award  survey 
efforts.  On  the  other  hand,  about  50  percent  of  the  contracts  could  probably  have  been 
effected  with  greater  emphasis  on  the  peculiarities  of  PPF,,  the  nature  of  the  TDP,  and  the 
amount  of  risk  to  be  assumed.  Some  of  the  major  theoretical  benefits  of  the  PPF.  concept 
are  that  it  should  encourage  the  “right”  prospective  contractors,  discourage  the  “wrong” 
ones  (ie.,  those  who  would  buy  in  and  who  do  not  have  the  general  capability  to  perform), 
and  markedly  improve  the  resulting  contractual  relationships  with  the  selected  contractor. 
Furthermore,  when  presolicitation  conferences  and  other  communicative  techniques  are  not 
utilized  due  to  the  time  and  expense  involved,  or  when  awards  are  made  primarily  on  the 
basis  of  price  without  extensive  negotiation,  a thorough  pre-award  survey  may  be  the  only 
effective  method  of  communication.  It  follows  that  (i)  a thorough  pre-award  survey  with 
emphasis  of  PPF.  should  afford  an  important  opportunity  to  effect  realization  of  these 
benefits;  and  (ii)  in  the  absence  of  such  a survey  the  benefits  may  be  lost.  Perhaps  more 
importantly  if  contractors  make  erroneous  assumptions  about  the  amount  of  risk  to  be 
assumed,  not  conducting  a pre-award  survey  may  he  counterproductive  to  the  success  of  the 
contract. 


(6)  l/dter/Certificate  of  Understanding.  In  one  of  Command  A’» 
contracts,  an  extensive  dialogue  took  place  prior  to  award  relative  to  the  PPF.  procedure,  the 
individual  procurement  action,  and  the  contractor’s  role  in  assuming  PPF.  responsibilities. 
The  exchange  was  concluded  with  a letter  written  and  signed  by  a high  official  of  the 
contractor’s  firm,  which  stated  that  the  contractor  thoroughly  understood  his  role  under  the 
PPF.  provisions.  During  contract  performance  a “show  cause’’  letter  was  issued  by  the 
Contracting  Officer  when  the  first  article  delivery  date  was  not  met  and  when  ihe  balance  of 
the  delivery  schedule  was  in  jeopardy.  Interestingly,  a part  of  the  contractor’s  response  was 
that  he  liad  not  fully  understood  nor  agreed  to  the  risks  relative  to  PPF.  at  contract 
inception,  notwithstanding  the  previous  letter.  It  would  seem,  however,  in  event  of 
litigation,  that  the  contractor’s  letter  would  be  a very  important  document  in  determining 
the  initial  agreement  of  the  parties. 

AMC  usage  of  PPF.  during  the  procurement  solicitation  phase  has  been  covered.  And 
now  the  study  will  review  AMC  PPF,  usage  in  the  Post  Award  or  Contract  Administration 
Phase. 

C.  CONTRACT  ADMINISTRATION  PHASE. 

1.  Number  of  PPF.  Contracts  by  Major  Subordinate  Commands,  Types  of  Contracts, 
and  Dollar  Values.  In  response  to  letters  of  inquiry,  six  AMC  procurement  activities 
including  the  arsenals  furnished  data  in  support  of  their  experiences  with  PPF.  provisions. 
The  number  of  relevant  contracts  by  year  and  the  participating  organizations  designated  by 
Commands  A through  F',  are  shown  in  Table  III-2;  the  total  approximate  dollar  value  of  the 
contracts  at  contract  inception,  appears  in  Table  III-3  and  the  number  of  contracts  by 
contract  type  is  shown  in  Table  ITI-4. 
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TABLE  I II -2:  NUMBER  OF  CONTRACTS  WITH  PPE  PROVISIONS  BY  MAJOR 

SUBORDINATE  COMMAND  BY  FISCAL  YEAR 


MSC 

Number  of  Contra* 

cts 

65-69 

70 

71 

72 

73  • 

Total 

Command  A 

5 

3 

4 

2 

- 

14 

Command  B 

4 

2 

3 

2 

- 

11 

Command  C 

3 

1 

2 

0 

— 

6 

Command  D 

1 

1 

1 

1 

— 

4 

Command  E 

0 

1 

0 

0 

1* 

2 

Command  F 

8 

12 

24 

31 

— 

75 

TOTAL  AMC 

21 

20 

34 

36 

i i 

1 

112 

•Contract*  were  surveyed  in  Fall  1972  and  one  contract  in  process  was  awarded  with  a FY 
73  number.  Other  FY  73  actions  are  not  listed  above. 


2.  Observations  on  Iw  of  PPE  in  C.onlracts.  Rased  on  data  provided  by  the  six 
MSC'g  which  were  obtained  during  field  visits  and  interviews,  the  following  observations  are 
pertinent. 

a.  Command  F has  used  PPF  provisions  in  significantly  more  procurements  than 
other  commands;  a total  of  75  contracts  were  observed.  Although  Commands  A,  R,  and  C 
have  fewer  contracts  than  Command  F,  PPF  provisions  have  been  employed  on  most  of 
their  major  relevant  procurements.  Roth  Command  D and  Command  F have  employed  the 
PPF  technique,  but  they  have  also  frequently  chosen  not  to  use  it.  For  example,  it  is 
conceivable  that  Command  R might  have  applied  PPF  on  40  procurements  rather  than  four 
during  the  past  few  years  and  Command  F on  20  instead  of  two.  In  short,  some  commands 
are  using  PPF  regularly  and  others  show  less  enthusiasm  in  its  use. 

h.  Table  III-3  tabulates  the  total  dollar  value  of  the  112  MSCs  contracts  with 
PPF  provisions  during  the  fiscal  years  of  1965  to  1973.  From  Table  111-3  it  can  easily  he 
calculated,  based  on  the  number  of  PPF  contracts  and  their  total  dollar  value,  that  the 
contracts  that  employed  the  PPE  concept  averaged  $5,451,816.  The  largest  dollar  value  was 
observed  at  Command  R where  PPE  was  applied  primarily  on  major  programs.  Similarly, 
Commands  C and  E PPF  procurements  are  large  dollar  value  contracts.  At  Command  F the 
dollar  size  per  procurement  action  is  leas  but  the  pattern  is  the  same,  i.e.,  the  PPE  technique 
has  been  applied  to  procurements  of  rignificant  dollar  value.  It  has  not  generally  been 
applied  to  minor  items  or  to  stock  fund  procurements. 

c.  Table  M-4  categorizes  PPE  contracts  by  the  type  of  contract.  From  Table 
II1-4  it  is  clear  that  most  applications  of  the  PPE  technique  were  with  contracts  of  the  Firm 
Fixed-Price  (FFP)  type;  However,  other  contract  types,  i.e.,  Fixed-Price  Incentive  (FFI)  and 
Cost-Plus-Incentive-Fee  (CPIF),  were  also  employed. 

d.  Several  of  the  organizations  solicited  during  the  conduct  of  this  study  did  not 
employ  the  PPE  technique.  Inquiries  to  determine  their  rationale  for  nonuse  of  PPF 
resulted  in  a vague,  rather  than  definitive,  set  of  explanations.  Some  of  the  activities 
solicited  were  not  engaged  in  procurements  where  PPF  provisions  would  he  applicable. 
Other  organizations,  however,  could  probably  have  found  areas  of  applicability  hut  did 
not-for  reasons  which  were  assessed  to  be  primarily  a lack  of  familiarity  and  understanding 
of  the  benefits  and  procedures.  Personnel  at  certain  activities  expressed  a strong  interest  and 
desire  for  more  positive  guidance  and  indicated  that  some  “in-house"  differences  of  opinion 
had  to  he  reconciled  before  the  concept  could  be  utilised.  Also,  one  activity  expressed  a 
desire  for  more  guidance,  especially  the  applicability  of  the  concept  to  procurement  actions 
concerned  with  transitioning  from  development  into  production. 
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I.  Observations  on  Price  Predetermination.  Price  predetermination  which 
compensates  the  contractor  for  correcting  TOP  deficiencies  under  the  PPF,  concept  is 
necessary  and  was  obviously  performed  before  award  of  the  112  contracts  observed.  The 
ability  of  a contractor  to  predetermine  (estimate)  a price  for  PPF,,  i.e.,  to  project  the  cost  of 
correcting  probable  TDP  errors  or  deficiencies,  is  established  by  a Comptroller  General 
decision.'*  Rased  on  field  visits,  the  following  observations  on  price  predetermination  are 
made: 


a.  Over  half  of  the  112  contract  files  reviewed  contained  complaints  from 
contractors  (either  prior  or  after  award)  concerning  the  difficulties  of  predetermining  a 
price.  Many  of  the  contractors  asserted  that  it  was  unreasonable  to  require  prospective 
contractors  to  make  such  estimates  and  to  be  responsible  for  the  accuracy  of  the  estimates, 
especially  when  the  allowable  TOP  review  time  was  short,  or  when  in-depth  communication 
was  not  conducted  about  the  particulars  of  the  TDP. 

b.  Post  award  review  of  contract  files  revealed  that  a few  contractors  alleged 
that  they  (i)  had  grossly  underestimated  costs  and/or  misunderstood  the  amount  of 
responsibility  involved;  (ii)  had  not  intended  to  enter  the  same  relationship  that  was 
apparently  intended  by  the  Government;  and  (iii)  had  no  recourse  but  to  demand 
consideration  of  these  facts  by  contract  adjustment,  notwithstanding  the  existence  of  the 
PPF,  provisions  in  their  contracts. 

c.  A near  consensus  of  opinion  by  both  Government  and  industry  is  that  it  is 
not  easy  to  predetermine  the  proper  price  for  PPF,.  The  number  of  potential  defects,  when 
they  are  discovered,  and  their  cost  and  time  impact  are  simply  unknown  factors  at  the 
inception  of  a contract.  Since  equitable  adjustments  are  unavailable,  the  predetermined 
price  for  the  estimated  quantity  of  work  and  risk  depends  upon  the  competitive  desires  of  a 
prospective  contractor,  his  interpretation  of  the  TDP  and  the  way  he  plans  to  manage  his 
contract. 

d.  Furthermore,  there  is  not  a consensus  throughout  AMC.  concerning  the  type 
or  amount  of  work  to  be  priced.  For  example,  some  personnel  preceived  the  need  for  an 
increased  contingency  factor  while  others  felt  that  contract  prices  already  contain 
contingencies  to  accommodate  PPF,  type  risks.  Some  personnel  felt  that  the  cost  of 
conducting  the  TDP  evaluation  (the  paper  study)  comprised  the  bulk  of  additional  efforts 
and  added  costs  while  other  personnel  felt  that  a TDP  must  be  reviewed  comprehensively 
with  or  without  PPF,  provisions.  In  addition,  others  preceived  the  need  for  a marked  increase 
in  the  estimated  costs  for  scrap  and  rework  effort  while  others  felt  that  such  costs  would  he 
included  in  the  “normal”  production  unit  price;  and  so  forth. 
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4.  Observations  on  Price  Separation  ami  Prices  Proposed  for  PPE.  In  overview, 
there  arc  two  distinct  camps  concerning  the  need  for  separate  pricing  of  PPF.,  i.c.,  those  who 
believe  it  should  be  separated  and  those  who  do  not. 

a.  Most  of  the  procurement  activities  endorse  the  principles  of  price  separation 
for  PPE.  But  at  least  one  does  not.  At  Command  A,  the  price  was  separated  in  most  of  their 
contracts  (in  one  case  the  lack  of  a separate  Contract  line  Item  Number  (CLIN)  was 
considered  to  be  an  administrative  oversight).  Table  III-5  illustrates  the  observations  relative 
to  this  point.  While  only  one  Command  B contract  appears  in  Table  III-5,  the  “PPE  price” 
was  evident  to  Command  B personnel  in  several  other  contracts.  For  example,  in  two 
different  Command  B contracts  not  shown  in  Table  III-5,  the  visible  prices  were: 

(i)  $73,000-which  represented  about  154  percent  of  the  contract  value;  and 

(ii)  $796— which  was  about  1 percent  of  the  item  unit  cost  of  $66,112.  Although  not 
observed  directly,  such  visibility  may  have  also  been  the  situation  in  the  two  Command  E 
contracts.  Command  C had  PPE  prices  separated  in  five  out  of  six  contracts;  at  Command  I) 
the  ratio  was  two  with  and  two  without.  However,  one  of  the  two  Command  I)  contracts 
without  a separate  CLIN  for  price  was  structured  to  include  a separate  price,  hut  was 
reduced  to  zero  dollars  during  price  negotiation.  (This  was  perceived  to  he  a 
misunderstanding  of  the  rationale  of  assuring  that  reasonable  payment  is  estimated  for  PPE 
responsibilities.  Rather  than  etiminHing  the  price  for  the  nominal  sum  proposed  in  that 
instance,  the  price  for  the  hardware  item  could  have  been  reduced  accordingly.) 

b.  While  the  totals  shown  in  Table  111-5  list  only  1 8 PPE  price  separations  out  of 
the  112  observed  contracts,  it  should  be  noted  that  the  proportion  is  misleading  because 
most  of  the  PPE  contracts  were  at  Command  F where,  as  a matter  of  command  policy,  there 
was  a decision  not  to  separate  prices  for  PPE.  .Several  personnel  at  Command  F countered 
by  asking  the  following  question:  “What  do  you  do  with  PPE  prices,  other  than  file  it  away 
as  nice  to  know  information?”  That  question  seemed  to  be  typical  of  the  PPE  philosophy  at 
Command  F.  Therefore,  at  Command  F prices  were  not  separated  either  as  a distinct 
contract  line  item  or  as  a negotiable  cost  element;  in  fact  the  majority  of  the  contracts  were 
effected  by  IFB  solicitations  which  precluded  negotiation. 


TABLE  ID-5:  SEPARATION  OF  PPE  PRICES  BY  LINE  ITEM 
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c.  On  the  average  in  18  cates,  Table  III-5  indicates  that  about  3 percent  of  the 
initial  contract  price  was  estimated  for  the  work  and  risks  associated  with  PPF  provisions. 
Hie  data  tends  to  be  more  informative  when  the  following  points  are  considered: 

(1)  Command  A's  contracts  were  primarily  for  initial  production  where 
specified  equipment  performance  characteristics  served  as  the  controlling  feature  of  the 
contract  relationship.  Furthermore,  extensive  communication  ensued  concerning  each  TDP 
and  the  potential  hazards  associated  with  the  contract  were  emphasized  prior  to  contract 
award.  The  concern  was  that  contractors  may  have  underpriced  rather  than  overpriced  the 
PPF,  tasks.  Also,  Command  A’s  contracts,  at  least  in  part,  had  a “proof*  quantity  of 
hardware  interrelated  with  the  price  for  the  evaluation  work  and  risks.  To  make  a direct 
comparison,  it  would  be  necessary  to  isolate  the  cost  attributable  to  the  proof  quantity. 


(2)  Commands  B and  C*s  equipment  were  characterized  by  large  unit  prices 
in  comparison  with  some  of  the  other  commands,  and  in  addition  some  of  the  procurements 
were  repeat  buys.  Furthermore,  the  transfer  of  responsibility  at  Command  B was  largely 
limited  to  “manufact la-ability  and  fit"  rather  than  attainment  of  performance.  About  three 
of  the  Command  C contracts  were  also  similarly  limited.  Therefore,  since  the  relationships 
were  less  stringent,  one  could  expect  the  price  to  be  less. 

d.  In  most  of  the  cases  the  price  separations,  for  PPF  covered  a wide  range.  This 
situation  was  not  unexpected  but  it  appeared  that  some  prospective  contractors  did  not 
understand  what  they  were  pricing.  Within  the  competitive  zone  of  consideration,  in  typical 
situations,  the  range  of  unit  prices  for  equipment  tended  to  form  a cluster  while  the  prices 
for  PPF  varied  more  widely. 


CIIAPTKR IV 

PROBLEMS  AND  PITFALLS  IN  APPLICATION  OF  PPE 
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A.  GENERAL 

During  the  course  of  this  study  many  problems  and  pitfalls  in  the  application  of  PPF. 
were  recorded  by  the  analysts.  However,  the  categorization  of  these  problems  and  pitfalls 
was  difficult  becaiwe  some  problems,  e.g.,  improper  use  of  PPE,  have  created  a chain 
reaction  of  additional  problems  and  pitfalls.  Also  some  of  the  problems  and  pitfalls  resulted 
from  the  way  the  PPF.  concept  is  presently  understood  and  interpreted  by  Government  and 
industry  whereas  other  problems  resulted  from  the  administrative  procedures  that  are 
contained  within  the  many  diverse  PPE  instructions  and  clauses  now  in  use.  To  avoid  a 
quagmire  of  analyses,  this  chapter  separates  problems  and  pitfalls  into  three  categories.  The 
first  category  involves  legal  and  contractual  problems  which  shoidd  he  considered  and  must 
be  overcome  before  any  new  procurement  concept  such  as  PPE  is  successfully  employed. 
The  second  category  entitled  “Major  Problems  in  the  Application  of  PPE”  identifies  the 
significant  problems  that  have  prevented  effective  application  of  the  PPE  concept.  These 
problems  are  considered  critical  and  their  existence  has  limited  the  successes  of  PPE  and  has 
contributed  to  many  of  the  minor  pitfalls  which  are  discussed  in  category  three.  This  third 
category  provides  a brief  summary  of  some  minor  pitfalls  that  have  been  encountered  in  the 
application  of  PPE.  A detailed  analysis  of  all  pitfalls,  many  insignificant,  was  considered  of 
questionable  value  since  most  of  the  minor  pitfalls  are  directly  attributable  to  major 
problems. 

B.  LEGAL  AND  CONTRACTUAL  PROBLEMS. 

1.  The  Consistency  of  l.egal  Decisions.  When  disputes  have  arisen  between  a 
contracting  officer  and  contractor,  the  courts  and  boards  have  almost  consistently  upheld 
i!'?  contractor’s  claims.  This  statement  also  holds  true  notwithstanding  the  existence  of  TDP 
disclaimers  and  other  evidence  to  show  the  absence  of  ai  intended  implied  warranty.*  T5«* 
rights  of  contractors  under  the  standard  Changes  clause  are  well  established  in  tradition  and 
will  continue  in  the  absence  of  a very  dear  contractual  understanding  to  the  contrary. 
Furthermore,  it  is  generally  held  that  the  Government  cannot  abdicate  its  responsibility  in 
toto  under  any  manner  of  exculpatory  language.  It  is  a party  to  its  contract*  ind  that  role 
inherently  carries  both  express  and  implied  responsibilities.  Also  without  evidence  of  mutual 
understanding  to  the  contrary,  the  ASBCA  and  court  decisions  have  upheld  both  the  express 
and  implied  terms  of  contracts  the  way  they  were  written,  rather  than  the  way  they  were 
meant  to  have  been  written.  If  a detailed  specification  of  work  was  furnished,  such  as  an 


engineering  drawing,  it  was  implied  that  it  would  lie  suitable  for  use,  unless  exculpated. 
Even  then,  h must  have  been  implied  that  extra  compensation  would  be  paid  for  correcting 
the  deficiencies  unless  the  language  called  for  a specific  assumption  or  risk  by  the 
contractor,  i.e.,  where  the  effort  was  specified  as  contractual  requirements  with  established 
provision  for  payment.^ 


2.  The  Misleading  Impression  of  Inevitahleness.  It  has  been  a problem  for  the 
Government  to  devise  effective  exculpatory  language.  The  very  consistency  of  the  legal 
interpretations  over  the  years  served  to  strengthen  the  belief  that  a broad  Government 
warranty  of  the  TDP  was  both  proper  and  nearly  inevitable.  In  circular  fashion,  the. 
strengthened  belief  generated  more  unrealistic  offers  and  bids  which  resulted  in  more 
unrealistic  contracts  (buying  in).  It  perpetuated  an  unrealistic  state  of  affairs  where  many 
production  contracts,  of  necessity,  underwent  frequent,  questionably-founded  and 
ill-structwed  adjustments  to  contract  prices  and  schedules. 

3.  The  Ease  of  Attaining  Contract  Adjustments.  Conversely,  to  the  prececding,  it 
has  been  relatively  “easy"  for  contractors  to  recover  cost  and  tune  via  the  implied  warranty 
method  of  recovery.  At  least  H has  been  much  easier  than  to  satisfactorily  demonstrate  the 
existence  of  an  impossible  condition,  a misrepresentation  or  a mutual  mistake,  which  are 
other  legal  methods  for  recovery  of  cost  and  time.'*  Although  perhaps  an  oversimplification, 
contractor  recovery  of  extra  price  and  time  has  often  been  a simple  matter  of  shuffling 
through  the  drawings  to  locate  a defect  or  two  with  the  knowledge  that  evidence  of  the 
mere  existence  of  almost  any  defect  would  be  negotiable,  if  any  adverse  consequences  could 
be  related  thereto. 

t.  Difficulty  of  Attaining  Contract  Adjustment.  Use  of  PPF,  concept  has  made  it 
exceedingly  difficult  for  contractors  to  recover  additional  cost  and  time  for  compatibility 
type  changes.  Perhaps  this  difficulty  as  contrasted  to  the  previous  ease  of  attaining  contract 
adjustments  has  led  to  a number  of  protests  and  claims  by  prospective  offerors  and 
contractors.  Right  Comptroller  General  decisions  involving  the  PPF.  concept  were  identified 
with  the  112  contracts  reviewed  during  this  study.  In  every  case  the  Comptroller  General 
upheld  the  Army’s  use  of  PPR  and  the  legality  of  the  concept.  However,  the  possibility  of 
additional  protests  and  claims  must  be  considered  as  potential  problems  that,  hopefully,  can 
be  avoided  by  proper  application  of  the  concept. 

C.  MAJOR  PROBLEMS. 

1.  PPF.  is  Not  Understood.  The  fundamental  and  major  problem  observed  in  the 
application  and  nonapplication  of  PPF.  was  a general  lack  of  awareness  and  understanding  of 
the  PPF.  concept.  Time  and  time  again  the  analysts  attempted  to  intelligently  dneuss  PPF. 
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with  functional  managers,  supervisors,  and  cognizant  lower  level  personnel  responsible  for 
the  engineering  and  procurement  of  production  quantities  of  Major  Weapon  System  Items. 
It  can  lie  asserted  that  only  a few  personnel  throughout  AMC  throughly  understand  the 
concept  and  even  these  few  disagree  as  to  how  or  even  if  it  should  be  used  in  particular 
cases. 

2.  PPF,  Terminology  and  Guidance  is  Confusing.  AMCP  71 5-6  describes  the  basic 
concept  of  PPE.  However,  it  also  describes  variations  and  departures.  The  net  results,  from 
AMC  point  of  view,  is  that  in  the  last  few  years  AMC  has  experienced  a movement  from  the 
PPF.  conceptual  phase,  i.e.,  where  multiple  approaches  are  possible  to  achieve  similar  goals, 
to  the  operational  phase  of  the  evolutionary  PPE  life  cycle  without  having  developed  and 
tested  a single  AMC  operational  baseline  with  latitude  for  departure. 

3.  Prcproduction  Evaluation  Has  Misleading  Connotations.  The  name 
“Preproduction  Evaluation”  is  at  the  source  of  major  problems.  The  PPF.  name  has  at  least 
three  misleading  connotations.  The  first  connotation  is  that  it  is  an  evaluation  process  that  is 
used  to  improve  the  quality  of  the  TDP.  The  second  connotation  is  that  evaluation  and 
application  of  the  PPF.  concept  continues  only  through  the  preproduction  phase.  And  third, 
the  acronym  PPF.  is  confused  the  Preproduction  Engineering  which  carries  a connotation  of 
“engineering"  to  be  done  on  something  that  needs  it  before  starting  production.  All  three  of 
those  connotations  are  in  contradiction  with  the  spirit  and  intent  of  the  basic  concept  which 
envisions  use  of  high  quality  TDPs  to  be  evaluated  throughout  the  entire  period  of  contract 
performance.  When  this  name  confusion  is  added  to  the  previously  discussed  PPF. 
terminology  and  guidance  confusion  it  is  easily  understood  why  the  concept  has  eluded 
comprehension  by  almost  everyone  in  the  MSCs. 

D.  SOME  MINOR  PITFALLS. 

A selected  number  of  some  of  the  more  important  minor  pitfalls  are  categorized  into 
(i)  Pitfalls  to  avoid  before  PPE  is  used;  (ii)  pitfalls  during  Solicitation  Phase;  and 
(iii)  pitfalls  after  Contract  Award.  Pint  the  pitfalls  that  should  be  avoided  before  the  use 
of  PPE  will  be  diacuaaed. 

I.  Pitfalls  to  Avoid  Before  PPE  is  Used. 

a.  PPF.  Should  Not  Be  Used  Indiscriminately.  Policy  on  the  application  of  PPF. 
at  the  MSC*s  covered  a wide  spectrum  and  included  no  or  limited  usage  at  some  MSC’s  to 
almost  blanket  application  at  Command  F.  However,  before  PPE  is  used  it  should  be 
determined  that  certain  basic  prerequisites  are  present.  The  restrictive  nature  of  such 
prerequisites,  which  are  diacuaaed  in  Chapter  V,  means  that  PPE  should  not  be  used 
indiscriminately. 
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h.  l)o  Not  Use  With  l<o%v  Quality  TIH*.  The  PPF.  concept  it  intended  for  use 
with  high  quality  TDP  that  is  essentially  in  compliance  with  Category  fi,  MII.-D-1000.  The 
PPF.  clause  only  provides  for  compatibility  type  changes  for  correction  of  errors, 
omissions,  and  deficiencies  in  TDP*s.  The  Government  must  resist  the  temptation  to  use  the 
PPF.  concept  with  low  quality  TDP  and,  thereby,  shift  an  undeterminable  cost  risk  to  the 
contractor. 

c.  Do  Not  llse  PPE  With  Simple  Items  When  Only  a Few  Compatibility  Clianges 
Are  Expected.  A TDP  for  a relatively  simple  item  would  likely  contain  only  a few  errors, 
omissions,  and  deficiencies  and  would  normally  be  deemed  a very  high  quality  TDP. 

However,  due  to  the  simplicity  of  the  TDP,  the  purpose  for  using  PPF.,  i.e.,  to  prevent  undue 
delays  and  excessive  cost  in  the  use  of  unproven  TDP,  would  not  he  served  by  application  of 

the  PPF.  technique.  For  example,  compatibility  changes,  if  any,  resulting  from  a TDP  for  a I 

simple  item  would  likely  be  few  and,  therefore,  not  become  complex  merely  because  of 
their  quantity  and  interaction.  Also  such  compatibility  changes  would  likely  lie  easily 
reviewed  and  quickly  implemented  under  the  provisions  of  the  standard  Changes  clause. 

Recause  of  the  simplicity  of  such  compatibility  changes,  they  would  he  easily  evaluated  and 
negotiated  by  Government  personnel.  Consequently,  such  changes  would  provide  limited 
opportunity  for  recovery  of  excessive  cost  and  time  under  provisions  of  the  Changes  clause. 

d.  Do  Not  Use  PPE  With  Cost- Reimb  use  men  t Contracts.  The  PPF.  concept 
shifts  the  cost  risk  for  correction  of  errors,  omissions,  and  deficiencies  to  the 
contractor.  However,  in  a cost-reimbursement  contract,  the  contractor  is  reimbursed  for  all 
allowable  costs  incurred  during  contract  performance.  Since  PPE  casts  are  necessary  for 
contract  performance  and  would  likely  be  allowable  coats,  the  use  of  cost -reimbursement 
contracts  would  prevent  the  shift  of  cost  risk  to  the  contractor  and  would  make  any  PPF. 
provision  meaningless. 

e.  Do  Not  Use  PPE  Technique  With  lFB*s  (Other  than  Two-Step 

lFB’sk  Firmness  of  specifications  is  one  of  the  basic  prerequisites  to  consider  before  the  I 

use  of  formal  advertising  (IFB’s).  However,  the  inclusion  of  a PPF,  provision  in  a solicitation 
indicates  that  specifications  are  less  than  firm.  If  specifications  are  less  than  fhm,  then 
logically,  the  formal  advertising  method  should  not  be  used.  Also  formal  advertising  does 
not  facilitate  effective  dialogue  between  industry  and  Government  which  is  necessary  to 
communicate  the  amount  of  risk  to  be  transferred  by  use  of  the  PPF,  technique. 

2.  Pitfalls  During  Solicitation  Phase. 
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a.  There  is  Ineffective  Communication  of  the  Amount  of  Risk 
Transferred.  Ineffective  communication  almost  always  causes  problems.  This  is  especially 
true  when  PPF,  provisions  are  used.  It  is  exceedingly  diff  It  to  communicate  TDP  quality 
information  to  prospective  contractors  so  that  intelligent  decisions  can  be  made  concerning 
the  magnitude  of  risk  that  must  be  assumed.  The  Government  must  assure  that  all  known 
information  concerning  the  quality  of  the  TDP  is  made  available  to  prospective  contractors. 
If  the  degree  of  work  and  risk  subsequent  to  award  turns  out  to  be  substantially  different 
from  that  which  could  reasonably  have  been  communicated  prior  to  contract  award,  it  is 
likely  to  have  either  one  or  two  undesirable  results:  (i)  an  equitable  adjustment  could  be 
claimed  and  enforced,  if  necessary,  through  the  ASBCA  or  the  courts,  notwithstanding  the 
PPF.  provisions;  or  (ii)  the  contractor  would  have  to  suffer  an  unfair,  perhaps  catastrophic, 
loss  because  of  the  PPE  provisions.  For  these  reasons  effective  communication  is  necessary 
relative  to  the  amount  of  risk  to  be  assumed  if  PPE  provisions  are  to  effectively  supplant 
equitable  adjustments  under  the  Changes  clause. 

b.  Do  Not  Commingle  Prices  for  PPE  With  Prices  for  Other  Contract 
Items.  When  PPE  prices  are  commingled  with  the  related  deliverable  contract  items,  the 
amount  of  cost  risk  that  the  contractor  estimates  for  PPE  is  difficult  to  determine.  In  fact,  it 
may  subsequently  be  alleged  that  no  cost  was  estimated  for  PPE.  To  assure  a meeting  of  the 
minds  concerning  the  transfer  of  cost  risk  and  the  presence  of  consideration  for  making  post 
award  corrections  of  errors,  omissions,  and  discrepancies  in  TDPs,  PPE  prices  should 
not  be  commingled  with  or  lost  in  the  prices  of  other  contract  items. 

3.  Pitfalls  After  Contract  Award. 

a.  Administrative  ftocedwee  of  PPE  Clauses  Must  He  Complied  With.  The  PPE 
clauses  used  by  MSCs  provide  only  a short  period,  usually  15  to  30  days,  for  the 
Government  to  review  and  approve  or  disapprove  CECPs.  Since  contractors  cannot  stop 
work  awaiting  the  Government’s  action,  most  PPE  clauses  contain  an  assumption  of  CECP 
approval  if  the  Government’s  disapproval  has  not  been  received  at  expiration  of  the  review 
period.  Also  most  PPE  clauses  provide  for  application  of  the  Changes  clause  for  any  CECP 
disapprovals  received  after  the  review  period.  Therefore,  before  PPE  is  used  it  is  incumbent 
on  the  Government  to  assise  that  timely  review  of  CECPs  will  be  accomplished.  This  may 
require  delegation  of  approval  authority  for  CECPs  from  a Configuration  Control  Board 
to  designated  engineering  personnel.  It  should  be  emphasised  that  sufficient  resources  must 
be  available  and  the  Government  must  be  responsive  to  CECPs.  Otherwise  the  Changes 
clause  will  apply  to  CECPs  and  the  pivpose  for  using  PPE  will  be  thwarted. 

. 
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b.  A Comprehensive  Evaluation  of  All  Changes  to  the  PPE  Contract  is 
Required.  Normally,  contract  changes  are  subject  to  implementation  under  the 
provisions  of  die  Changes  clause  or  implementation  under  other  contract  provisions  such 
as  the  Value  Engineering  Incentive  clause.  Since  the  Changes  clause  allows  for  price 

increases  and  delivery  extensions,  the  contractor  would  have  an  incentive  to  interpret  any  f 

changes  that  are  not  clearly  CEC’s  in  this  category.  Conversely,  Uiere  would  be  an 
incentive  to  include  as  CECP’s  any  doubtful  changes  which  could  properly  be  classified  as 
Value  Engineering  Change  Proposals.  This  points  out  the  importance  of  having  a PPE 

clause  which  clearly  defines  CEC's.  However,  it  also  exposes  another  pitfall  and  shows  the  f 

importance  of  having  a comprehensive  Government  evaluation  of  all  changes  submitted 
under  a PPE  contract. 

c.  Substantial  Design  Deficiencies  Are  Not  Included.  A critical  pitfall  \ 

involves  the  types  of  deficiencies  that  contractors  will  be  responsible  for  correcting  under 

PPE  provisions.  The  PPE  clauses  currently  in  use  have  not  resolved  this  pitfall.  This 
assessment  resulted  from  the  following  observations:  (i)  a prospective  offeror  declined  to 
propose  because  it  seemed  to  him  that  the  Government  wanted  someone  to  “do  the 
engineering.”  He  stated  Uiat  he  would  be  pleased  to  perform  production  work  but  only 
after  the  engineering  had  been  finished;  (ii)  numerous  cases  were  observed  wherein 
prospective  contractors  requested  clarification  about  whether  design  as  well  as  “technical 
data”  errors  and  omissions  were  intended  to  become  the  responsibilities  of  the  contractor; 

(iii)  numerous  contractors  expressed  confusion  after  award  about  whether  the  PPE 
provisions  included  design  deficiencies;  some  were  adamant  that  they  did  not  enter  the 
contracts  with  an  intent  to  be  responsible  for  design  deficiencies. 

Paraphrasing  a basic  premise  of  AMCP  715-6,  the  contractor,  under  PPE 
provisions  is  to  be  completely  responsible  for  both  producibility  and  performance  in 
accordance  with  the  contract  specifications  and  any  attempt  to  relieve  the  contractor  of 
responsibility  for  design  changes  essential  to  equipment  performance  should  be  limited  to 
systems  which  are  primarily  mechanical  in  nature.  Such  relief  would  be  entirely 
impractical  in  contracts  for  electronic  equipment  since  most  incompatibilities  in  the 
technical  data  will  normally  involve  circuit  function  rather  than  form  and  fit.  On  the 
other  hand,  AMCP  715-6  acknowledges  a limitation  on  the  degree  of  design  responsibility 
to  be  transferred  and  states  that  any  tendency  to  place  a degree  of  design  responsibility 
upon  the  PPE  contractor  which  would  be  inconsistent  with  a firm  fixed-price  or 
fixed-price  incentive  contract  and  specified  schedule  requirements  should  be  carefully- 
avoided. 
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Responses  received  during  the  interviews  of  this  study  affirmed,  even  where 
the  equipment  was  primarily  electrical  in  nature,  that  substantial  development  of  the  details 
of  the  product  design  was  not  intended.  However,  it  was  reported,  (i)  that  some  design 
effort  may  be  inherent  or  at  least  incidental  to  the  task  of  manufacturing  die  Hem(s);  and 
(ii)  that  nearly  any  change  to  the  TDP  can  be  construed  as  a design  change.  In  fact,  several 
individuals  interviewed  elaborated  on  the  difficulty  of  defining  data  deficiencies  and  design 
deficiencies.  Indeed  if  a distinction  can  be  drawn,  it  would  normally  require  a face-to-face 
dialogue  between  two  expert  and  unbiased  engineers  to  equitably  allocate  the  respective 
responsibilities. 

The  degree  of  responsibility  to  be  transferred  for  development  of  the  details 
of  the  product  design  was  absent  from  the  express  language  of  many  of  the  contracts 
observed.  Therefore,  in  the  absence  of  express  language,  it  would  seem  that  a reasonable 
implication  would  be  that  some  responsibility  for  design  deficiencies  was  intended  to  lie 
transferred  (except  where  excluded)  but  not  a substantial  amount;  i.e.,  not  an  amount 
which  would  be  inconsistent  with  the  whole  of  the  other  contract  provisions. 

In  summary  offerors,  contractors,  and  Government  personnel  are  confused 
over  the  design  responsibilities.  Numerous  confrontations  liave  occurred  over  this  matter, 
and  more  can  be  expected  unless  it  is  clarified.  It  is  considered  a mistake  to  distinguish 
between  design  and  data  deficiencies,  even  where  the  procurement  items  and  systems  are 
primarily  mechanical.  An  express  exclusion  of  design  responsibility  would  increase  the 
number  of  changes  which  would  have  to  be  equitably  adjusted  under  the  Changes  clause. 
While  this  problem  may  not  be  critical  to  the  success  of  a given  procurement,  it  would 
reduce  or  even  negate  other  important  benefits  of  the  PPF,  concept.  That  is,  it  would  tend  to 
build  in  to  the  contract  the  very  adversities  that  the  PPE  concept  attempts  to  defeat.  It 
would  encourage  rather  than  discowage  incapable  or  mismotivated  offeron.  It  would 
increase  rather  than  decrease  the  probability  of  “getting  well”  or  “getting  more”  during 
contract  performance.  For  these  reasons  the  need  to  clarify  the  issue  of  design  responsibility 
and  the  need  to  carefully  control  exclusions  of  design  responsibility  are  considered  to  be 
pitfalls  which  may  adversely  affect  both  individual  procurement  actions  and  viable  on-going 
relationships  with  indurtry.  In  particular  instances,  industry  may  be  pleased  wherever 
“design  responsibility”  (whatever  that  means)  is  excluded  or  even  where  the  contractor  is 
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relieved  in  part  from  such  responsibilities.  Ilut  in  the  larger  sense,  the  problem  is  not  to 
exclude  fair  allocation  of  responsibility  but  to  more  clearly  define  what  * fair.  At  present,  a 
fair  allocation  seems  to  involve  some  but  not  a substantial  degree  of  design  responsibility.  A 
more  definitive  description  of  a fair  allocation  simply  does  not  exist  at  the  present  time  and 
it  would  vary  case  by  case.  A division  of  responsibility  based  upon  the  word  “substantial" 
would  be  more  meaningful  and  equitable  than  a division  based  on  the  differences  between 
“data”  and  “design”  deficiencies,  especially  since  the  word  substantial  could  be  defined  for 
each  procurement  action  in  order  to  narrow  the  opportumty  for  dnagreements. 


CHAPTER  V 

GUIDELINES  FOR  BETTER  APPLICATION  OF  PPE 


A.  GENERAL  OBSERVATIONS  ON  USE  AND  CONTINUED  USE  OF  PPE. 

1.  Preproduction  evaluation  as  a new  procurement  concept  has  received  both 
criticism  and  praise.  Many  Government  personnel  tike  the  concept  while  others  dislike  it  or 
treat  it  with  indifference.  It  can  be  rationalized  that  any  new  procurement  technique  would 
meet  some  resistance,  if  only  because  of  the  natural  human  resistance  to  change.  Rut  the  use 
of  PPE  procedures  has  resulted  in  marked  resistance  during  recent  years.  In  numerous 
observed  instances  pretests  were  filed,  letters  of  complaint  were  sent  to  contracting  officers, 
and  personal  visits  were  made  by  corporate  officials  to  headquarters  elements.  However, 
early  in  the  development  phase  of  the  PPE  concept  undue  importance  should  not  he 
attributed  to  such  resistance  by  industry.  It  is  considered  advisable  to  keep  an  open  mind,  if 
possible,  about  the  merits  of  PPE  and  listen  to  any  and  all  complaints  of  industry  to  better 
understand  their  specific  objections.  By  so  doing  new  ideas  and  better  ways  of  improving 
the  PPE  concept  may  be  learned  for  the  mutual  benefit  of  Government  and  industry. 

2.  After  an  exhaustive  analysis  of  the  PPE  concept  which  culminated  in  this  study, 
the  analysts  agree  that  PPE  is  fundamentally  a sound  and  potentially  a viable  and  effective 
concept.  For  example,  Table  V-l  indicated  that  an  average  of  100  compatibility  changes 
are  approved  per  contract  throughout  the  MSC’s  of  AMC.  Since  these  are  the  same  type 
of  changes  that  are  covered  by  PPE  provisions,  the  potential  benefits  of  PPE  are  great. 
Although  the  average  of  100  approved  CEC’s  for  all  contracts  may  be  misleading  when 
compared  to  PPE  type  contracts,  it  has  been  observed  that  numerous  contracts  with  PPE 
have  experienced  hundreds  and  a few  contracts  have  experienced  over  a thousand  changes 
without  requiring  the  negotiation  of  an  equitable  adjustment  of  prices  and  delivery.  A few 
specific  observations  on  PPE  are  as  follows: 

a.  With  approximately  3,900  drawings,  excluding  military  standards,  a 
Command  B contract  had  1,335  approved  changes  out  of  1 ,727  CECP  submissions.  (As  an 
aid  to  visualization  of  the  magnitude  of  the  activity,  it  occupied  1 2 file  drawers  of  changes 
and  each  change  affected  an  average  of  three  drawings.) 

b.  In  a Command  C contract  over  2,000  changes  were  processed.  This  was  also 
an  awesome  situation,  especially  as  viewed  by  the  personnel  intimately  involved  with 
processing  the  changes. 
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c.  Command  F’s  family  of  items,  a member  of  the  ACO's  team  attested  that 
approximately  1 ,800  changes  had  been  processed.  (This  data  was  received  informally  with  a 
lapse  of  time  after  the  field  survey.) 

d.  Regarding  one  of  Command  C*s  contracts,  the  Government  engineer  asserted, 
“there  is  no  question  about  the  value  of  PPE  on  this  contract.  Over  500  changes  were 
processed  in  the  form  of  60—70  CECP* s prior  to  the  first  reticle  approval.” 


TABLE  V-l.  APPROXIMATE  NUMBER  OF  APPROVED  CECs  OBSERVED 


Major  Subordinate 

Total  of  All 

Average  Pier 

Command 

Contracts 

Contract 

Command  A 

2,765 

312 

Command  B 

2,843 

258 

Command  C 

2,622 

437 

Command  D 

450 

112 

Command  E 

60 

30 

Command  F 

1,503 

20 

TOTAL  AMC 

10,243 

91 

1 " 

(10,000)* 

(100)* 

N 

High  Frequency 
Observed 


*If  the  recently  issued  contracts  were  to  be  excluded  from  the  computation,  the  averages 
AMC-wide  would  be  approximately  10j000  CECs  divided  by  100  contracts  for  a contract 
average  of  10C  CECs. 


e.  In  Command  Fi  contracts  to  cite  only  two  examples  among  about  70 
contracts,  1 15  CECP*s  were  approved  in  one  contract  and  150  CECPs  were  observed  in 
another. 


3.  In  summary  the  attitudes  of  most  AMC  participants  in  this  study,  both  as 
individuals  and  as  organisations,  are  generally  favorable  to  the  concept  of  PPE.  In  addition 
the  analysts  subjective  assessment  of  observed  PPE  contracts  and  their  assessment  of  the 
potential  benefits  of  PPE  points  toward  continuation  of  the  concept,  but  only  with  a 
refined  and  more  selective  application. 
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n.  BASIC  PREREQUISITES  FOR  USE  OF  PPE 


To  provide  a foundation  for  understanding  the  specific  guidelines  recommended  by 
this  chapter,  the  basic  prerequisites  for  use  of  PPE,  which  parallel  the  criteria  contained  in 
AMC  715-6,  are  stated  below: 

1.  A detail  design  Technical  Data  Package  must  be  available  in  full  conformance  with 
Category  E,  Specification  MIL-D-1000.  By  definition,  Category  F,  (Procurement  of  Identical 
Items)  also  includes  Category  F drawings  (Procurement  of  Interchangeable  Items)  which 
would  include  Source  Control  and  Specification  Control  drawings,  as  appropriate. 

2.  The  item  to  In*  procured  should  be  a major  item  or  system  of  at  least  moderate 
complexity.  The  simpler  items  on  which  relatively  few  engineering  changes  may  be  expected 
would  not  normally  require  or  justify  the  more  sophisticated  PPF.  contracting  approach. 

3.  The  end  item  detail  specification  must  be  complete  and  accurate  with  respect  to 
all  essential  functional  requirements.  ^ 

C.  SPECIFIC  GUIDELINES  FOR  BETTER  APPLICATION  OF  PPE. 

1.  Guideline  1— A Thorough  Government  Review  of  TDP  Quality  Must  Be  Completed 
Before  the  Procurement  Solicitation  Phase.  Measurement  of  the  quality  of  a TT>P  to  assess 
how  effectively  it  can  fulfill  its  intended  use  has  been  a major  problem  throughout  AMC. 
Unlike  hardware,  a TDP  cannot  be  adequately  tested  and  inspected  until  someone  other 
than  the  developer  of  the  TDP  has  actually  used  it  successfully.  In-depth  Government  and 
third  party  reviews  have  limitations  and  it  is  not  economically  feasible  to  eliminate  every 
error  by  any  known  method.  Studies  and  probes  into  this  general  problem  area  have  been 
conducted  and  a technique  that  provides  a limited  measure  of  TDP  quality  has  been 
developed. ^ Notwithstanding  the  existence  of  such  a technique,  the  Government  must 
conduct  an  intensive  review  to  determine  TDP  quality.  At  the  very  least  the  general 
parameters  of  the  TDP  should  be  identifiable  from  its  use  in  previous  procurements,  past 
configuration  audit  data,  inspection/acceptance  records,  in-house  or  third  party  review 
findings,  and  the  general  knowledge  of  the  offices  with  mission  responsibility.  Such 
information  must  be  communicated  to  prospective  contractors  during  the  procirement 
solicitation  phase  to  permit  a predetermination  of  prices  for  the  risk  to  be  assumed.  In 
summary  it  should  be  emphasittd  that  adequate  review  of  TDP  quality  is  most  important 
and  it  should  be  given  top  priority.  Not  only  does  adequate  review  provide  the  Government 
with  information  to  determine  whether  or  not  PPE  should  be  used,  but,  if  used,  it  provides 
information  that  is  necessary  for  determination  of  a fair  and  reasonable  price  for  PPE. 


2.  Guideline  2— line  PPE  on  Complex  Procurements  Where  Numerous  CCEC’s  Are 
Anticipated.  The  complexity  of  the  procwcments  which  employed  PPE  was  considered 
during  this  study.  The  PPE  concept  fundamentally  addresses  complex  rather  than  simple 
items,  but  the  definition  of  complexity  was  found  to  be  somewhat  vague.  Almost  any  item 
of  Military  Design  Equipment  takes  on  complex  characteristics,  at  least  when  compared 
with  “off-the-shelf  items.  The  degrees  of  novelty,  uniqueness,  and  state  of  the  art  affect 
relative  complexity  and  are  reasons  for  anticipating  numerous  CEC’s.  Rut  the  only 
measurable  observations  available  during  the  study  was  the  approximate  number  of  drawings 
of  some  of  the  items  together  whh  a few  of  the  unit  prices.  This  data  is  depicted  in  Tables 
V-2  and  V-3.  From  Table  V-2  it  is  evident  that  many  of  the  TDPs  had  thousands  of 
drawings  and  related  documents.  On  the  other  hand,  Command  F used  PPE  with  at  least  one 
TI)P  of  only  40  drawings  and  a unit  price  of  $3.15.  Whether  the  PPE  concept  has  been  used 
on  items  of  lesser  complexity  is  perhaps  debatable,  but  it  is  not  recommended  by  this  study. 
The  point  is  that  the  concept  has  been  used  on  items  which  are  characterized  as  both  very 
high  and  quite  low  in  complexity.  Also  the  relationship  of  the  number  of  product  drawings 
to  the  anticipated  number  of  CEC’s  has  been  estimated  at  approximately  one  to  four;  that 
is,  for  every  four  drawings  a CEC  could  be  expected.^  Identification  of  the  ratio  of  CEC’s 
to  drawings  was  an  effort  beyond  the  scope  of  this  study.  Rut  observations  indicated  that 
the  ratio  may  vary  widely,  i.e.,  from  1j3,  1:4,  1:50,  but  averages  1:6.  This  points  out  that 
the  number  of  anticipated  CEC’s  for  a given  TDP  is  (i)  difficult  to  estimate;  and 
(ii)  that  it  would  depend  on  several  variables  such  as  the  degree  of  review  and  inspection 
of  the  TDP,  the  number  of  times  it  has  been  previously  produced,  the  number  of  drawing, 
and  other  TDP  documents,  the  nature  of  the  commodity,  unit  price,  and  so  forth.  More 
importantly,  it  would  also  depend  on  the  particular  contractor  selected  to  perform  the 
ensuing  production.  In  summary,  it  should  be  stated  that  it  is  impossible  to  precisely 
establish  the  degree  of  complexity  or  an  anticipated  number  of  CEC’s  that  would  justify 
the  use  of  PPE.  The  only  guidance  is  that  PPE  should  be  used  on  a case-by-case  basis  and 
then  only  with  relatively  complex  procurements  where  a large  number  of  CEC’s  are 
expected. 
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TABLE  V-2:  APPROXIMATE  NUMBER  OF  PRODUCT  DRAWINGS  AND  THE  UNIT 
PRICES  IN  SOME  OF  THE  OBSERVED  CONTRACTS 


Major 

Subordinate 

Command 

APPROXIMATE  NUMBER  OF 
PRODUCT  DRAWINGS 

UNIT  PRICE 

l (*> 

High 

Low 

High 

Low 

Command  A 

3,000 

144 

61,785 

4.58 

Command  B 

3,900 

N/A 

66,122 

2,571.00 

Command  C 

3,000 

500 

106,667 

1,600.00 

Command  D 

9,921 

508.00 

Command  E 

— * 

_* 

105,300 

Command  F 

7,000 

40 

8,735 

3.148 

AMC-WIDE 

7,000 

40 

106,667 

3.148 

*Data  not  observed 


TABLE  V-3:  A COMPARISON  OF  THE  APPROXIMATE  NUMBER  OF  PRODUCT 

DRAWINGS  WITH  THE  APPROXIMATE  NUMBER  OF  CEC’s  PROCESSED 


No.  of 
Contracts 
Observed 

r* 

Major 

Subordinate 

Command 

No.  of 
CEC’s 

No.  of 
Product 
Drawings 

Average  No. 

of  CEC’s 
Per  Drawing 

12 

Command  A 

.24 

1 

Command  B 

.33 

2 

Command  C 

.04 

— 

Command  D 

— 

— 

Command  E 

HH 

— 

8 

Command  F 

190 

.02 

23 

AMC-WIDE 

4,313 

27,240 

.16 
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^ Guideline  3— Die  PPE  on  initital  Production  Contracts  and  Subsequent 
Procurements.  AMCP  715-6  envisioned  that  PPF  would  be  used  primarily  with  initial 
production  contracts.  However,  the  extensive  employment  of  RPR  in  subsequent 
procurements  was  surprising  to  the  analysts.  An  analysis  of  the  various  contracts  confirmed 
that  the  PPF  technique  has  much  wider  applicability.  Several  MSC’s  used  it  on  procurements 
which  had  experienced  major  revisions  to  the  TDP  and  numerous  repeat  buys  were 
observed.  To  test  the  complexity  (Guideline  2),  the  approximate  number  of  CRT’s 
occurring  on  repeat  buys  was  compared  with  initial  production  contracts  in  Table  V-4. 
About  one  third  as  many  CRT’s  occurred  in  repeat  buys  as  in  initial  production  contracts, 
but  the  average  of  66  still  represents  what  is  considered  a numerous  quantity.  Certainly,  it  is 
enough  to  cause  the  incidence  of  delays  and  price  increases  when  each  of  the  66  is  subject  to 
negotiation.  Furthermore,  several  of  the  personnel  interviewed  stressed  that  instead  the 
incidence  of  CRT’s  tends  to  be  reduced  in  stair-step  fashion.  In  many  cases  the  continuous 
incidence  of  numerous  changes  surprised  personnel.  At  Command  F,  the  relatively  rapid 
technological  turnover  was  cited  as  the  reason  for  the  reoccurrence  of  CRT’s.  Hut  at 
Command  B,  a similar  pattern  of  many  TEC’s  was  observed  during  subsequent 
procurements.  One  assessment  that  can  be  made  in  view  of  the  number  of  CRCs  which 
have  occurred  in  subsequent  procurements,  is  that  development  of  an  error-free  TDP  may  be 
more  of  an  ideal  state  than  a realistic  expectation.  Another  assessment  is  that  the  PPF. 
technique  has  applicability  in  subsequent  procurements  as  well  as  initial  production 
contracts  if  numerous  CEC's  are  expected. 
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TABLE  V-4:  APPROXIMATE  NUMBER  OK  EEC’S  OBSERVED  ON  REPEAT  BUYS 
IN  COMPARISON  WITH  INITIAL  PRODUCTION  CONTRACTS* 


Major 

Subordinate 

Command 

INITIA 

1.  PRODUCTION 

REPEAT  BUYS 

Total 

Average 

Number  of 

Contracts 

Total 

Average 

Number  of 

Contracts 

Command  A 

786 

87 

9 

1,979 

396 

5 

Command  B 

2,553 

5 

290 

48 

6 

Command  C 

2,421 

5 

201 

201 

1 

Command  D 

431 

215 

2 

19 

10 

2 

Command  E 

N/A 

N/A 

N/A 

60** 

30** 

2 

Command  F 

224 

19 

12 

766 

22 

34 

TOTAL  AMC 

6,415 

194 

33 

3,315 

66 

50 

♦Computed  from  observations  where  a distinction  was  known  between  initial  production 
and  repeat  buys. 


♦♦Information  received  subsequent  to  survey  indicated  that  approximately  1,500  changes 
were  incorporated  in  a major  contract;  this  would  markedly  increase  the  observed  data 
depicted  above. 

4.  Guideline  4— Use  PPE  With  “Full  Quantity”  Production  Contracts.  In  all 
procurements  observed,  the  respective  quantities  under  contract  would  be  characterized  as 
“full”  rather  than  “limited”  except  for  fow  of  the  procurement  actions  at  Command  A. 
These  Command  A procurements  were  for  lesser  quantities  than  were  to  be  subsequently 
procured  by  another  activity.  That  is,  a contract  for  300,000  items  at  Command  A was 
intended  to  achieve  production  refinement  of  the  TDP  for  subsequent  procurement  of 
3,000,000  identical  items  by  another  activity.  For  use  of  PPE  with  less  than  a full  quantity, 
the  reader  should  be  familiar  with  the  technique  called  “proof  lot”'*  as  explained  in  AMCP 
715-6.  While  the  use  of  PPE  provisions  at  Command  A seemed  generally  effective,  the 
reasons  why  PPE  provisions  were  not  also  employed  in  the  follow-on  contracts  by  the  other 
procuring  activity  could  not  be  clearly  determined.  It  would  seem  that  the  full  range  of 
benefits  from  use  of  the  PPE  technique  was  forfeited  either  for  the  need  for  extremely  tight 
configuration  control  of  the  TDP  during  the  larger  quantity  procurements  or  for  reasons 
attributable  to  lack  of  awareness  of  the  potential  benefits  of  PPE. 
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5.  Guideline  5— Use  PPK  Throughout  the  Span  of  Contract  Performance.  One  MSG 
departed  from  the  term  preproduction  evaluation  very  early.  They  choose  to  call  the 
technique  Production  Evaluation  (PF.)  because  the  evaluation  of  the  TDP  and  the 
assumption  of  risks  continue,  in  their  conception,  to  the  end  of  the  contract.  This 
conception  agrees  with  that  prescribed  by  AMCP  715-6,  except  that  the  names  differ.  The 
difference  in  names  may  not  be  critical  because  “a  rose  by  any  other  name  is  still  a rose." 
But  it  was  evident  from  the  interviews  conducted,  that  this  Command  strongly  resisted  the 
implications  of  the  term  PPE.  Also  evident  from  the  reviews  was  the  fact  that  many 
contractors  would  have  preferred  to  have  their  risks  cease  with  respect  to  compatibility 
deficiencies  as  actual  production  commenced.  It  was  not  easy  for  personnel  of  this 
Command  to  hold  their  contractors  to  their  responsibilities  throughout  the  span  of 
performance;  it  was  necessary  to  clarify  that  aspect  of  the  concept  again  and  again. 

Command  I)  also  employed  PPE  provisions  throughout  the  span  of  the  contract, 
but  their  recent  procurement  instruction  relative  to  the  PPE  technique  in  future 
procurements  called  for  cessation  of  PPE  provisions  after  completion  of  first  article. 
Command  C negotiated  the  PPE  provisions  out  of  one  of  their  major  contracts  after 
completion  of  first  article.  The  precise  reasons  for  this  action  were  not  clear.  Even  though  it 
was  proper  to  freeze  the  baseline,  the  resultant  effect  on  the  success  of  the  contract  is 
questioned.  Especially  if  the  contractor  submits  numerous  CECPs  which  have  to  be 
negotiated  under  the  Changes  clause.  In  many  other  contracts  the  frequency  and  severity  of 
changes  continued  relatively  high  after  first  article,  e.g.,  out  of  a total  of  150  CECPs  in 
one  contract,  50  were  submitted  subsequent  to  first  article,  30  of  which  were  alleged  to  be 
of  the  cost-increasing  type.  Several  engineers  interviewed  throughout  the  commands  attested 
to  a rough  rule  of  thumb  estimate  of  20  percent  prior  to,  50  percent  during,  and  30  percent 
after  the  first  article  or  preproduction  model  phase. 

Command  A's  employment  of  PPE  provisions  suggested  a heavy  emphasis  on  the 
evaluation  function,  even  though  they  did  require  continuous  contractor  assumption  of  risk 
to  the  end  of  the  contract.  Commands  R and  E,  also  consistently  employed  the  full  effect  of 
the  PPE  provisions  throughout  the  full  span  of  contract  performance. 

* 

In  further  discussion  of  the  confusion  caused  by  the  name  PPE,  it  should  be  noted 
that  several  nonuse rs  of  PPE  provisions  interviewed  during  this  study  stated  that  they 
routinely  do  the  same  things  as  are  accomplished  under  PPE  except  that  the  functions  are 
labeled  with  different  names.  Upon  closer  investigation,  it  quickly  became  apparent  that 
efforts  similar  to  PPE  to  which  they  referred  did  not  include  predetermination  of  prices  and 
the  shift  of  responsibility  and  risks  associated  with  CD's. 
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The  selected  name  of  the  concept,  Preproduction  Evaluation,  denotes  a specific 
technique  with  several  functional  elements,  but  it  carries  a strong  connotation  that  the 
main  step  is  an  evaluation  that  will  be  completed  prior  to  production.  Perhaps  evaluation 
is  tire  most  important  step.  But  the  primary  objective  of  PPE  is  to  shift  the  responsibility 
of  correction  of  errors,  omissions,  and  discrepancies  in  TDP’s  from  the  Government  to  the 
contractor,  a function  which  is  not  implied  by  name.  It  is  likely  that  this  connotation  has 
influenced  the  manner  by  which  the  PPE  technique  has  been  employed  at  some 
organizations,  as  indicated  above.  Perhaps  a more  descriptive  name  for  the  PPE  concept, 
e.g.,  “Compatibility  Engineering  Change  Responsibility”  (CECR)  should  be  used  to 
indicate  the  concept  is  ideally  employed  throughout  contract  performance  and  involves  a 
shift  of  responsibility  to  the  contractor. 

6.  Guideline  6— Use  With  Both  Competitive  and  Noncompetitive  Procurements. 

tsnn  a a • . ■ ~ " . . . * 


PPE  may  be  used  with  competitive  and  noncompetitive  procurements.  j 

a.  Competitive  Procurements.  The  PPE  concept  is  an  attempt  to  improve  j 

the  Government’s  ability  to  successfully  introduce  competition  in  complex  procurements  1 

of  military  design  equipment.  Therefore,  the  primary  application  would  be  expected  in 

the  competitive  environment  and  this  was  the  observation,  as  evident  from  Table  V-5.  Of  \ 

the  83  contracts  reviewed,  74  (89  percent)  were  competitively  solicited  and  awarded. 

Based  on  evidence  in  32  of  these  contracts,  eight  firms  both  large  and  small  businesses,  ! 

expressed  an  interest  in  participating  in  the  procurements  notwithstanding  the  PPE 

provisions. 


TABLE  V-5:  CONTRACTS  WITH  PPE  PROVISIONS  AWARDED  COMPETITIVELY  AND  NONCOMPETITIVELY 


h.  Noncompetitive  Procurements.  Appendix  K of  AMCP  715-6  sets  forth  a 
sample  “Certification  of  Technical  Data”  clause  which  establishes  special  PPE  provisions  for 
noncompetitive  contracts,  in  one  way  or  another  this  clause  was  tailored  to  fit  nine  of  the 
83  contracts  observed  or  about  1 1 percent.  The  analysts  feel  that  a tailored  version  of  the 
clause  is  applicable  to  substantially  more  noncompetitive  procurements.  However,  several  of 
the  personnel  interviewed  seemed  to  he  unaware  of  the  purpose  and  procedures  and  in  some 
cases  the  existence  of  the  noncompetitive  version  of  the  PPE  clause. 

7.  Guideline  7— Use  PPE  with  RFP*s,  PFQ’g,  and  Two-Step  I Ell's.  PPE  provisions 
must  be  employed  in  solicitations  which  permit  effective  pre-award  communication  with  all 
prospective  contractors  concerning  TDP  quality.  Three  solicitation  methods,  request  for 
proposals,  request  for  quotations,  and  two-step  formal  advertising,  permit  and  encourage 
communication  between  Government  and  industry.  The  use  of  these  solicitation  methods  is 
considered  appropriate  since  the  PPE  concept  requires  a firm  understanding  of  its  special 
provisions,  responsibilities,  and  limitations. 

8.  Guideline  8— Use  PPE  with  Firm  Fixed-Price  (FFP)  and  Fixed-Price  Incentive 
(FP1)  Contracts.  By  definition  PPE  is  a shift  of  the  cost  risk  associated  with  compatibility 
changes  from  the  Government  to  the  contractor.  Also  by  definition  a FFP  contract  in 
relation  to  a cost-reimbursement  contract  is  a shift  of  the  cost  risk  of  performance  from  the 
Government  to  the  contractor.  Since  PPE  is  only  one  of  a contractor’s  many  cost 
considerations,  H is  felt  that  PPE  is  best  utilized  under  an  FFP  contract.  However,  an  FPI 
contract  is  a variation  of  an  FFP  contract  and  transfers  only  slightly  less  risk  to  the 
contractor.  Therefore,  an  FPI  contract  is  also  considered  appropriate  for  application  of  the 
PPE  concept.  To  use  any  other  type  contract  with  PPE  is  a contradiction.  For  example,  use 
of  a cost-reimbursement  type  contract  with  PPE  would  be  mean  ingles*  since  the 
Government  would  ultimately  reimburse  the  contractor  for  all  allowable  costs,  including 
PPE  costs,  that  are  incurred  during  contract  performance. 

9.  Guideline  9— Provide  Separate  Line  Item  Prices  for  PPE.  Failure  to  indude  PPE 
as  a separate  contract  line  item  number  (CLIN)  in  the  solicitation  even  though  it  is  not  easy 
to  estimate  what  the  PPE  effort  costs,  could  mislead  a contractor  and  imply  that  the 
Government  does  not  foresee  the  PPE  effort  m a major  part  of  the  production  contract.  If 
both  the  Government  and  the  contractor  are  unable  to  define  the  PPE  requirement,  it  must 
be  ambiguous  and  a possible  mutual  mistake  could  be  made  thus  potentially  allowing  the 
contractor  to  appeal  for  an  equitable  adjustment  at  a later  date.  Any  such  claim  would 
probably  be  upheld  by  the  courts.  Therefore,  it  is  considered  desirable  and  preferable  to  be 
able  to  identify  PPE  prices.  This  can  be  accomplished  by  requiring  that  a price  be  induded 
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for  the  PPE  CLIN.  It  would  alto  be  permissible  not  to  separately  price  (NSP)  the  PPE  CLIN 
provided  that  PPE  prices  can  be  easily  identified.  This  can  be  accomplished  by  including 
NSP  in  the  amount  column  and  including  the  PPE  price  in  parentheses  within  the  item 
description  block  of  the  PPE  CLIN.  Primary  among  the  several  discrete  benefits  which 
accrue  from  separately  identifiable  PPE  prices  is  an  increased  ability  to  detect  and  rectify 
gross  misunderstandings  before  and  during  negotiations  and  before  a contract  is  awarded. 

10.  Guideline  10— Use  Appropriate  Pre-Award  Communication  Techniques  to  Insure 
a Mutual  Understanding  of  PPE.  When  the  PPE  technique  is  to  be  used  with  its  significant 
transfer  of  responsibilities  to  a contractor,  it  is  incumbent  on  the  Government  to 
acknowledge  its  superior  knowledge  about  the  relative  status  of  the  TDP  so  that  a clear 
understanding  will  form  the  .basis  of  a mutually  satisfactory,  as  intended  contractual 

relationship.  Some  facets  of  the  status  of  the  TDP  may  not  be  known  by  the  Government,  1 

but  that  which  is  known,  or  should  be  known,  should  be  transmitted.  It  follows  that  the 

level  of  the  necessary  communication  varies,  i.e.,  in  one  case  the  degree  of  information 

exchanged  during  the  solicitation  phase  may  be  relatively  low;  in  another  case  an  extensive 

exchange  of  information  may  be  vital.  Unless  the  Government  states  otherwise,  a 

prospective  contractor  would  likely  infer  that  the  TDP  “quality  index  factor”  would  be  high 

and  that  substantial  development  work  would  not  be  intended,  notwithstanding  an 

acknowledgment  of  the  potential  existence  of  .CD’s,  whenever  a competitive  solicitation  is 

issued  for  a fixed-price  type  supply  contract.  When  that  situation  is  not  the  intended 

contractual  relationship,  it  is  incumbent  upon  the  Government  to  communicate  as 

effectively  as  possible  in  whatever  ways  it  can  to  provide  offerors  the  opportunity  to  assess 

the  risks  and  to  minimize  erroneous  assumptions  about  the  relative  soundness  of  the 

Government-finished  TDP.  Methods  of  improving  pre-award  communications  include 

presolicitation  conferences,  technical  proposals,  allowance  for  extra  “on  the  street”  lead 

time,  negotiation  conferences,  pre-award  surveys  and  letter/certificate  of  understanding. 

Most  of  these  communication  methods  are  appropriate  even  without  PPE,  but  certain  of 
these  methods  may  be  required  when  transferring  responsibility  by  the  PPE  technique 
because  of  the  unavailability  of  an  equitable  adjustment  subsequent  to  award.  Furthermore, 
it  would  seem  to  be  especially  important  to  be  as  informative  as  possible  in  view  of  the 
inherent  difficulties  of  attaining  accurate  quality  measurement  of  the  TDP  and  mutual 
understanding  of  the  intended  contractual  relationship. 

D.  GENERAL  GUIDELINE  FOR  BETTER  APPIJCATION  OF  PPE. 

Selective  Application  of  PPE  is  Appropriate.  The  work  and  risks  within  the  PPE 
concept  are  not  neatly  severable  from  that  which  would  be  expected  to  almost  any 
“normal"  supply  contract.  To  illustrate  this  point,  factors  in  Table  V-6  can  be  seen  to  affect 
both  contracts  with  and  without  PPE  provisions.  In  view  of  the  commonalities  of  work/risk 
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relationships,  some  personnel  interviewed  at  several  different  commands,  felt  lliat  the  PPF, 
technique  should  be  included  in  all  contracts  except  where  it  would  be  justified  to  exclude 
it.  They  feel  that  the  effort  is  normal  to  review  the  TOP,  correct  it  as  necessary,  and  proceed 
in  accordance  with  the  correct  version.  This  viewpoint  emphasizes  the  act  of  correcting  the 
TDP  and  deemphasizes  the  assignment  of  responsibility  for  the  consequences  of  the  CCD’s. 
Other  individuals  perceive  the  application  of  PPF  provisions  to  be  extraordinary.  During  the 
study  of  the  PPF,  concept,  the  theme  prevailed  that  the  efforts  of  coping  with  TDP  defects 
has  consistently  been  interpreted  by  the  courts  and  Itoards  to  be  extraordinary  and, 
therefore,  worth  of  added  price  and  time.  Also,  since  the  courts  have  consistently  granted 
equitable  adjustments  without  PPF,,  the  act  of  assigning  responsibility  differently  should  be 
taken  selectively  rather  than  automatically.  The  question  posed  is  perhaps  whether  use  of 
PPF  is  normal  in  the  world  that  ought  to  be  or  the  world  that  is  in  actuality.  Certainly,  the 
adoption  of  one  view  or  the  other  has  affected  PPF  applications.  That  is,  if  the  PPF  effort 
and  risk  are  perceived  as  normal  without  added  cost  and  benefit,  it  follows  that  standard 
application  would  avoid  the  undesirable  consequences  of  its  absence  when  needed  and 
where  not  needed  the  provisions  would  be  free.  However,  if  the  effort  and  risk  are  viewed  as 
extraordinary,  with  both  costs  and  benefits  flowing  from  its  use,  it  follows  that  application 
would  be  recommended  only  in  cases  which  promised  a net  benefit.  The  latter  selective 
application  of  PPF,  is  recommended  by  this  study  and  this  is  the  approach  that  has  been 
practiced  by  Commands  A,  B,  C,  I),  and  F..  However,  standard  application  of  the  PPF, 
techniques  as  utilized  by  Command  F,  is  not  recommended  and  a standard  operating 
procedure  approach  should  be  avoided. 
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TABLE  V-6:  WORK/RISK  RELATIONSHIPS  BETWEEN  CONTRACTS  WITH  AND 
WITHOUT  PPE  PROVISIONS 


Work/Risk  Category 

Extent  of  Contractor  Effort/Risk 

Without  PPE 

With  PPE 

Review  of  TDP  for  CD’s 

Some 

More 

Technical  Analyses 

Some 

More 

Worst  Case  Analyses 

Some 

More 

Trial  and  Error  Fabrication 

Some 

More 

of  Hardware 

Submission  of  CECPs 

Some 

More 

Implementation  of  CECPs 

Without  Contract  Adjustment 

Some 

More 

Contingencies 

Some 

More 

Applicable  Profit 

Some 

More 
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CHAPTER  VI 

SUMMARY,  CONCLUSIONS,  AND  RECOMMENDATIONS 

A.  SUMMARY. 

Chapters  I,  II,  and  III  evaluated  the  theory  of  Preproduction  Evaluation  as  defined  by 
AMCP  715-6  and  looked  at  the  PPE  concept  from  both  a conceptual  viewpoint  and  » 
practiced  by  the  major  subordinate  commands  of  AMC.  The  reasons  for  using  PPE,  i.e.,  to 
prevent  undue  delays  and  excessive  cost  in  the  use  of  an  unproven  TOP,  and  the  reasons  for 
TDP  deficiencies  were  analyzed  in  Chapter  II.  During  this  study,  112  contracts  at  MSC’s, 
representing  the  total  population  of  contracts  with  PPE  provisions  that  were  in  existence 
within  AMC,  were  reviewed.  Additional  data  and  observations  were  derived  from  letters  of 
inquiry,  interviews,  and  a review  of  relevant  literature.  In  Chapter  III  a review  of  the  112 
contracts  at  MSC’s  provided  considerable  data  on  the  types  of  solicitations,  and  types  of 
.contracts  that  employed  the  PPE  technique.  Observations  were  also  provided  on 
communicative  techniques,  e.g.,  solicitation  of  technical  proposals,  presolicitation 
conferences,  post-award  conferences,  extra  solicitation  lead  time,  pre-award  surveys,  and 
letter/certificates  of  understanding.  Also  data  and  observations  were  obtained  on  the  dollar 
value  of  contracts  and  the  usage  of  PPE  at  the  respective  MSC’s.  The  potential  as  well  as  the 
problems  and  pitfalls  of  PPE  were  identified  and  categorized.  Under  problems  and  pitfalls, 
Chapter  IV  explored  the  legal  and  contractual  problems  that  must  be  overcome  before 
successful  application  of  PPE.  Also  major  problems  and,  in  many  cases,  the  resulting  minor 
pitfalls  were  discussed.  In  summary,  Chapters  IV  and  V contained  guidance  which  should  be 
helpful  in  avoiding  problems  and  pitfalls  and  in  applying  PPE  in  a more  consistent  manner. 

B.  CONCLUSIONS. 

This  study  resulted  in  the  conclusion  that  PPE  is  not  generally  understood  by 
personnel  of  the  MSC’s.  It  was  revealed  that  there  is  considerable  disagreement  tat  to  how 
PPE  should  be  used  and  even  whether  it  should  be  used  in  particular  cases.  It  was  concluded 
that  there  is  a lack  of  AMC  guidance  on  the  proper  usage  of  PPE.  As  a result  of  this  void, 
local  PPE  instructions  have  evolved  with  their  varying  interpretations  and  terminology 
which  is  confusing  to  both  industry  and  Government.  Finally,  it  was  concluded  that  it  n 
desirable  to  continue  utilizing  the  PPE  procedure.  The  basic  reasons  for  using  it  still  remain. 
In  spite  of  many  problems,  and  notwithstanding  that  one  MSC  applies  and  administers  the 
technique  in  questionable  ways,  the  procedure  has  been  employed  with  at  least  limited 
effectiveness.  It  is  felt  that  most,  if  not  all,  of  the  problems  and  pitfalls  can  be  overcome  or 
at  least  reduced  to  manageable  proportions  by  concerned  management  analysis  and 
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guidance.  Past  experience  has  amply  demonstrated  that  in  TDP’s  of  even  the  highest  qualitv, 
a competitively  selected  production  contractor  will  identify  numerous  changes  that  are 
required  to  correct  errors,  omissions,  and  discrepancies  and  to  meet  the  objectives  of  the 
procurement  action.  At  the  present  time,  the  PPE  technique  of  correcting  TDP  deficiencies 
without  additional  cost  or  delivery  delay  is  one  of  a very  few,  if  not  only,  pre-award 
solution  to  this  real-life  problem.  Accordingly,  the  PPE  concept  should  be  refined  and 
improved  rather  than  abandoned. 

C.  RECOMMENDATIONS. 

To  provide  a better  understanding  and,  consequently,  more  consistent  application  of 
the  PPE  concept,  it  is  recommended  that  AMC  issue  an  AMCPI  on  PPE  and  revise  AMCP 
715-6.  It  is  also  suggested  that  a more  descriptive  name  for  the  PPE  concept,  e.g., 
“Compatibility  Engineering  Change  Responsibility”  (CECR)  be  used.  It  is  deemed  advisable 
to  rename  the  concept  since  the  name  “Preproduction  Evaluation"  presently  has  different 
meanings  throughout  AMC.  It  would  be  difficult  enough  to  implement  consistent  usage  of 
the  PPE  concept  without  being  hampered  by  the  diverse  terminology  and  misconceptions 
currently  associated  with  the  concept. 

To  provide  the  basis  for  more  consistent  application  of  the  PPE  concept,  major 
problems  and  minor  pitfalls  as  well  as  10  specific  guidelines  for  better  application  of  PPE 
were  postulated  by  Chapters  IV  and  V,  respectively.  Minor  pitfalls  are  esjiecially  important 
since  in  many  cases  they  are  in  the  form  of  recommendations  on  when  not  to  use  PPE. 
These  minor  pitfalls  were  separated  by  Chapter  IV  into  three  categories  and  s id) categories  as 
follows: 

1.  Pitfalls  to  Avoid  Before  PPE  Is  Used. 

a.  PPE  should  not  be  used  indiscriminately. 

b.  Do  not  use  PPE  with  a low  quality  TDP. 

c.  Do  not  use  PPE  with  simple  items  when  only  a few  changes  are  expected. 

d.  Do  not  use  PPE  with  cost-reimbursement  contracts. 

e.  Do  not  use  the  PPE  technique  with  IFB's  (other  than  two-step  lFB's). 

2.  Pitfalls  During  Solicitation  Phase. 
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a.  There  is  ineffective  communication  of  the  amount  of  risk  transferred. 


I 


b.  Do  not  commingle  prices  for  PPK.  with  prices  for  other  contract  items. 

3.  Pitfalls  After  Contract  Award. 

a.  Administrative  procedures  of  PPF.  clause  must  be  compbed  with. 

b.  A comprehensive  evaluation  of  all  changes  to  the  PPE  contract  is  required. 

c.  Substantial  design  deficiencies  are  not  included. 

As  a result  of  the  above  observed  pitfalls,  10  specific  guidelines  for  improved 
application  of  the  PPK  concept  were  recommended  and  discussed  in  Cliapter  V.  As  would  be 
expected,  many  of  these  guidelines  are  the  converse  of  the  pitfalls  listed  above.  The  10 
specific  guidelines  recommended  for  better  application  of  PPK  are  summarised  as  follows: 

Guideline  1— A thorough  Government  review  of  TDP  quality  must  be  completed 
before  the  procurement  solicitation  phase. 

Guideline  2— Use  PPE  on  complex  procurements  where  numerous  CECFs  are 
anticipated. 

Guideline  3— Use  PPK  on  initial  production  contracts  and  subsequent 
procurements. 

Guidebne  4— Use  PPE  with  “full  quantity**  production  contracts. 

Guideline  5— Use  PPE  throughout  the  span  of  contract  performance. 

Guidebne  6— Use  PPE  with  both  competitive  and  noncompetitive  procurements. 

Guidebne  7— Use  PPE  with  RFPs,  RFQ’s,  and  two-step  IFB’s. 

Guideline  8— Use  PPE  with  FFP  and  FP1  contracts. 

Guidebne  9— Provide  for  separate  line  item  prices  for  PPE. 
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(Guideline  10— Use  appropriate  pre-award  comtnunieation  techniques  to  insure  a 
mutual  understanding  of  PPK. 

In  addition  to  the  above  guidelines  a proposed  definition  of  compatibility  type 
deficiencies  and  key  terms  associated  with  PPK  are  included  in  Appendix  A to  this  study. 
However,  these  key  definitions  are  only  the  beginning.  Before  any  improvement  in  the  PPK 
technique  can  be  effected,  the  following  steps  must  be  taken: 

_Ste|>_l.  Draft  a proposed  standard  PPK  clause  that  nay  be  tailored  for 
individual  procurements  and  which  includes  common  terminology  and  definitions. 

Step  2.  Revise  the  proposed  standard  PPK  clause  after  formal  coordination  with 
the  MSC’s  of  AMC. 

Step  3.  Review  and  approve  the  proposed  standard  PPK  clause  by  AMC. 

Step  4.  Implement  the  standard  PPK  clause  and  improve  understanding  of  the 
concept  by  revision  of  AMCP  715-6  and  concurrent  issuance  of  an  AMCPI  on  the  standard 
PPK  concept. 

Step  5.  Provide  on-site  training  classes/seminars  on  the  standard  PPK  concept  as 
contained  in  the  revised  AMCP  715-6  and  AMCPI. 

The  Procurement  Research  Office  is  presently  drafting  a proposed  standard  type  PPK 
clause  (step  1 above)  as  part  of  this  study  effort.  This  clause  will  be  forwarded  to  AMC  at 
which  point  it  is  recommended  that  the  advisability  of  implementing  steps  2—5  be 
considered  for  implementation. 

In  summary,  it  is  emphasized  that  continued  use  of  PPK  by  MSC’s  of  AMC  is 
recommended.  It  is  believed  that  the  guidelines  and  findings  of  the  study  will  enable  the 
MSC’s  to  better  utilize  the  PPK  technique  and  take  local  actions  that  are  directed  toward  a 
standardization  of  the  PPK  concept  notwithstanding  implementation  of  steps  1 through  5 
above.  Finally,  it  should  be  emphasized  that  the  PPK  concept  is  to  be  wed  selectively  and 
not  indiscriminately. 
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APPENDIX  A 
DEFINITION  OF  TERMS 

1.  Technical  Data.  Technical  data  arc  recorded  information  used  to  define  a design  anti 
to  produce,  support,  maintain,  or  operate  items  of  defense  materiel.  These  data  may  lie 
recorded  as  graphic  or  pictorial  delineations  in  media  such  as  drawings  or  photograph;  text 
in  specifications  or  related  performance  or  design  type  documents;  in  machine  forms  such  as 
punched  cards,  magnetic  tape,  computer  memory  printouts;  or  may  Ik*  retained  in  computer 
memory.  Examples  pf  recorded  information  include  engineering  drawings  and  associated 
lists,  specifications,  standards,  process  sheets,  manuals,  technical  reports,  catalog  item 
identifications,  and  related  information.  For  purposes  of  this  study,  research  and 
engineering  data  are  included  hut  financial  and  administrative  data  are  excluded. 

2.  Technical  Data  ftekage  (TDP).  A collection  of  technical  data  products  (items)  which 
is  complete  for  a specific  use.  As  used  in  this  study  the  term  also  generally  refers  to  the 
category  of  intended  use  where  the  item,  with  modifications,  is  one  planned  for  multi-year 
wage  ami  will  involve  several  supply  production  contracts.  Generally,  full  design  disclosure 
data  ami  procurement  data  are  required. 

if.  Procurement  Data  faduge.  A collection  of  all  data  necessary  for  procurement  of  the 
items  which  it  pertains,  e.g.,  engineering  drawings,  specifications,  manufacturing 
information  essential  to  production,  and  test  procedures.  [It  is  not  intended  that 
unnecessary  manufacturing  data  such  as  flow  charts,  process  sheets,  tool  designs,  etc.,  be 
furnished  to  support  competitive  procurement.  However,  there  are  many  cases  where  it  may 
be  necessary  or  desirable  to  make  unlimited  rights  therein.  ] 

4.  Manufacturing  Support  Data.  Generally  comprises  (i)  operation  sheets  and 
machine  instruction  sheets:  (ii)  machine-loading  data;  (iii)  treatment  data;  (iv)  tools, 
jigs,  and  fixtue  data;  (v)  product,  process,  or  assembly  data;  and  (vi)  plant  layout, 
machine  took,  and  work  station  data. 

5.  Full  Design  Disclosure  Data.  Full  design  disclosure  data  is  information  complete 
to  the  extent  necessary  to  support  a procurement  or  permit  manufacture  without  additional 
design  effort,  and  without  recourse  to  the  original  design  activity. 


6.  Source  Control  Drawing.  A source  control  drawing  is  one  which  defines  the 
required  item  entirely,  or  in  part,  by  means  of  a vendor’s  pari  number.  It  may  include 
additional  functional  test  or  configuration  specifications,  but  since  these  are  in  themselves 
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inadequate  to  assure  proper  performance,  installation,  and  interchangeability  of  the  item  in 
a specific  application,  procurement  of  the  item  is  thus  effectively  restricted  to  the  approved 
soiree  or  sources  listed  on  the  drawing. 

7.  Specification  Control  Drawing  and  Performance  Specification.  A specification 
control  drawing  which  delineates  requirements  for  an  item  in  terms  of  functional  and  test 
specifications  and  external  configuration  data,  with  a little  or  no  delineation  of  internal 
design  or  constructional  features.  It  will  cite  one  or  more  suggested  vendor  part  numbers.  A 
performance  specification  is  defined  similarly,  except  that  it  is  prepared  in  the  form  of  a 
Military  Design  Specification  in  accordance  with  DOD  4120.3-M  (Defense  Standardization 
Manual).  A performance  specification  is  used  in  preference  to  a specification  control 
drawing  for  items  to  be  repetitively  and  separately  procured;  when  inspection  and  test 
requirements  are  lengthy  and  complex;  or  when  the  establishment  of  a Qualified  Products 
last  (QPI.)  is  planned.  Vendor  part  numbers  are  included  in  military  specifications  only  in 
the  form  of  a QPL. 

fl.  “Contractor  Responsible”  Deficiencies  and  Key  PPF  Terms.  An  improvement  is 
needed  in  defining  those  TDP  deficiencies  for  which  contractor  responsibility  is  intended. 
AMCP  715-6  states:  (i)  the  importance  of  a carefully  drawn  definition  for  both 
“compatibility"  and  Government-directed  charges  cannot  he  overemphasized;  and, 
(ii)  “Simplicity  of  definition  should  be  strived  for."  However,  this  goal  has  not  been 
achieved  and  a consistent  set  of  key  terms  needs  to  be  formulated  and  adopted  throughout 
AMC.  which  (i)  uniquely  apply  to  use  of  the  PPF.  technique;  and  (ii)  conform  primarily 
to  the  name  and  definition  of  the  type  of  TDP  deficiency  for  which  contractor 
responsibility  is  intended,  with  latitude  for  contraction  or  expansion  of  the  parts  of  the 
definition  of  that  particular  deficiency  as  may  be  necessary  to  meet  the  needs  of  a given 
subordinate  command  or  an  individual  procurement  action. 

Hie  word  “compatibility,"  as  a name  for  the  subject  deficiency,  has  been  almost 
universally  adopted  throughout  AMC  as  the  most  descriptive.  In  view  of  the  prevailing 
usage  of  the  word  “compatibility”  it  seems  appropriate  to  describe  the  subject  deficiency 
as  a “Compatibility  Deficiency”  (CD). 

A viable  definition  of  a CD  seems  to  also  be  available  from  a careful  ordering  of  the 
definitional  elements  which  have  already  evolved.  Under  the  PPF  provisions  observed 
throughoirt  AMC  as  an  entity,  to  be  transferred  (Le.,  a CD)  generally  had  the  following 
characteristics: 
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a.  It  would  have  been  incompatible  with  the  basic  contractual  objectives  to 
deliver  quality  supplies  in  a timely  manner  in  accordance  with  the  TOP  as  furnished  or 
as  supplemented  by  authorized  changes. 

b.  It  would  have  conformed  to  the  meaning  of  a Code  A or  C “compatibility'’ 
change  as  defined  by  MIL- STD-480,  with  only  minor  departure. 

c.  It  would  have  occurred  at  any  time  throughout  the  contract  performance 

period. 

d.  It  would  have  been  an  error,  omission,  discrepancy,  outdated  aspect  or 
inadequacy  with  respect  to  process  data  for  which  a change  to  the  TDP  had  been  mutually 
deemed  essential  or  mutually  desirable  if  deemed  nonessential. 

e.  It  would  have  precluded  performance  and  manufacture  on  the  one  hand  or 
just  manufactire  on  the  other,  depending  upon  whether  the  relevant  equipment  was 
primarily  electrical  or  mechanical  and  whether  the  contractor  was  the  developer/previous 
producer  or  a competitively  selected  source. 

f.  It  may  have  also  precluded  other  important  objectives  such  as  attainment  of 
compatibility  between  the  various  parts  of  the  TDP,  or  physically  and  functionally  suitable 
purchased  parts  and  materials. 

g.  It  may  or  may  not  have  been  a change  to  correct  a previous  change; 
depending  on  whether  the  specific  contract  provisions  encompassed  this  situation. 

h.  It  would  not  have  represented  a significant  improvement  or  enhancement  to 
the  product. 

i.  It  would  not  have  been  a Government-directed  change. 

j.  It  would  not  have  been  a Value  Engineering  or  Cost  Reduction  change. 

k.  It  would  not  have  been  a change  which  would  have  caused  a reversal  of  the 
intended  order  or  precedence  of  the  documents  within  the  TDP,  i.e.,:  Where  “design" 
responsibility  to  completely  achieve  specified  levels  of  performance  was  intended  to  be 
excluded,  it  would  not  have  been  a “design”  change;  otherwise,  it  may  have  been  a “design" 
change. 

l.  It  would  not  have  been  a deficiency  which  would  have  required  substantial 
development  of  the  details  of  the  product  design  although  it  may  have  involved  some 
development  of  or  revisions  to  details  of  the  product  design. 
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in.  It  would  not  have  been  a deficiency  which  would  have  rendered  the 
contract  impoMibie  or  commercially  impracticable  to  perform. 

Each  of  the  characteristic*  of  a CD  listed  above  can  be  and  has  been  more 
elaborately  described  or  defined  with  greater  technical  precision  in  both  AMCP  715-6  and 
the  contracts  issued  with  PPE  provisions.  Therefore,  it  is  concluded  that  one  relatively 
common  name  and  one  relatively  common  set  of  definitions  should  be  developed.  As  a 
“strawman”  in  this  behalf,  Table  A-l  lists  some  definitions  of  several  key  terms  which 
were  conceptualized  during  the  course  of  this  study  and  which,  hopefully,  will  result  in 
better  understanding  and  improved  usage  of  the  PPE  concept. 


TABLE  A 1:  DKKINIT10NS  OK  SPECIAL  TERMINOLOGY  AND  ACRONYMS 
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I 


Number 


Key  Term,  Acronym  and  Definition 


1.  Compatibility  Engineering  Change  Responsibility (CKCR).  The 

responsibility  to  perform  the  work  and  assume  the  consequential  risks 
associated  with  identification  and  correction  of  Compatibility  Deficiencies 
(CD's),  submission  of  CECP’s  that  will  resolve  the  incompatible  conditions 
and  implementation  of  the  approved  C.KCP's  without  compensation  or 
extensions  of  delivery  time  other  than  that  established  at  contract  inception. 
(The  Government  assumes  responsibility  for  rejected  CECP’s  to  the  extent  of 
the  impact  of  the  rejection.) 


Basic  Contractual  Obligation  (I1CO).  The  contractor’s  obligation  would  l*e 
specifically  defined  by  a total  set  of  contract  provisions:  but  it  can  be 
generally  defined  as  the  responsibility  to  produce  and  deliver,  in  a timely 
manner,  supplies  conforming  to  the  quality,  configuration  and  performance 
requirements  depicted  within  the  TDP,  either  as  furnished  or  as 
supplemented  by  approved  changes  during  performance  of  the  contract.  This 
would  include  attainment  of: 

a.  Function  and  performance  requirements. 

L Manufacturing  and  assembly  requirements. 

c.  Physically  and  functionally  suitable  purchased  parts  and  materials. 

d.  Compatibility  between  specified  quality  assurance  provisions  and 
the  mandatory  physical  and  functional  requirements  of  the  specifications 
and  drawings. 

e.  Compatibility  between  engineering  parts  lists  and  other  technical 

data. 

f.  Correction  of  mutually  recognized  errors  in  specifications  cited, 
where  such  correction  will  provide  greater  compatibility  with  the  existing 
detailed  design. 
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Table  A-l:  Continued 

t 

f 

* 

1 

Number  j 

Key  Term,  Acronym  and  Definition 

Compatibility.  Capable  of  existing  together  in  harmony;  such  as  to  agree; 
consistent,  congruous.  (The  term  “compatibility"  in  its  broadest  sense,  most 
effectively  describes  the  type  of  engineering  changes  of  particular  concern 
within  the  PPE  concept  and  is  a state  or  condition  within  which  the 
multifaceted  aspects  of  a given  TDP  are  compatible  with  the  BCO.) 

Compatibility  engineering  Change  (CEC).  An  engineering  change  issued  to 
correct  or  otherwise  reconcile  the  problems  posed  by  one  or  more  CD’s. 
(Kncompasses  both  Compatibility  engineering  Change  Proposals  (CCCP's) 
and  approved  CECP's.) 

Compatibility  engineering  Change  Proposal  (CBCP).  An  BCP  issued  by  the 
contractor  to  identify  the  CD,  explain  the  need  for  a CEC,  and  propose 
technical  resolution  to  the  incompatible  condition. 

Compatibility  Deficiency  (CD).  A TDP  defect  which  the  parties  mutually 
agree  necessitates  a CECP  at  any  time  during  performance  of  the  contract 
because  it  gives  rise  to  a condition  which  is  incompatible  with  the  RCO, 
except,  for  ECP’s  that  are  predominantly  characterized  for  classification  in 
one  of  the  excepted  categories  listed  below: 

a.  I, CP’s  to  improve  the  product  performance  and  reliability  beyond 
that  required  by  the  specification^)  cited  in  the  contract. 

b.  Value  Engineering  Change  Proposals  and  Cost  Reduction  Proposals. 

c.  Covemment-directed  Engineering  Changes.  Expanded  explanation: 
See  MIL-STD480  for  categories  of  changes  which,  if  unilaterally  directed 
would  be  excluded  from  CECR. 

d.  ECP’s  related  to  selected  tasks,  components,  proven  subassemblies, 
packaging,  Government-furnished  property  or  material  or  other  areas  that 
have  been  expressly  excluded  from  the  responsibilities  of  the  contractor. 
Expanded  explanation:  Selected  assets  of  the  TDP  may  be  contractually 
selected  tests,  particular  components,  proven  subassemblies,  packaging,  etc., 
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Table  A-l:  Continued 


Key  Term,  Acronym  and  Definition 


e.  KCP’s  to  resolve  inconsistencies  l»e tween  (be  engineering  draw  ing* 
and  performance  specifications  where  implementation  of  the  KCP  would 
constitute  a reversal  of  the  provisions  of  the  Order  of  Precedence  clause. 
Expanded  explanation: 

(1)  Where  the  drawings  lake  precedence  over  the  specification!*),  in 
the  event  of  an  inconsistency,  a change  to  the  drawings  to  facilitate 
attainment  of  specified  |>erforii:anre  levels  would  not  lie  considered  a change 
to  correct  a CD. 

(2)  Conversely,  where  the  performance  specification^)  lake 
precedence  over  the  drawings,  in  the  event  of  an  inconsistency,  a change  to 
the  drawing  to  facilitate  attainment  of  specified  |ierfonnance  levels  would  lie 
considered  a change  to  correct  a CD. 

f.  KCP’s  related  to  defects  in  previously  issued  engineering  changes  of 
any  category,  provided  the  contractor  lias  notified  the  contracting  officer, 
within  a specified  number  of  days  after  approval  of  the  KCP  in  question,  of 
his  unwillingness  to  assume  CKCR  with  res|>ect  to  the  subject  approved  KCP. 
Kxpanded  explanation: 

(1)  The  issuance  of  changes  is  subject  to  the  same  propensity  for 
error,  omission,  and  discrepancy  as  the  initial  descriptions  of  requirements. 

(2)  Yet  a contractor  cannot  readily  agree  to  warrant  the  suitability  of 
future  changes  until  he  has  an  opportunity  to  review  the  changes.  CEC!< 
would  not  be  effective,  therefore,  until  some  manner  of  consent  has  ensued; 
of  course,  a Government  implied  warranty  would  prevail  in  the  interim  and 
the  procuring  activity  may  wish  to  assume  responsibility  for  all  such  changes. 

g.  KCP's  involving  substantial  development  of  the  details  of  the 
product  design,  unless:  (i)  the  contract  expressly  requires  substantial 
development  of  particular  portions  of  the  product;  or  (ii)  the  contractor  is  to 
assume  all  the  uncovered  risks  inlierent  in  its  promised  fterformance. 
Expanded  explanations: 
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Table  A-l: 

■ 

i 

I 

• i 

f 

Continued 

Number 

Key  Term,  Acronym  and  Definition 

(1)  Since  almost  any  change  to  the  TOP  ran  lie  construed  as  a change 
to  the  “design,”  the  word  substantial  is  es|>ecially  significant  as  a line  of 
distinction  between  the  respective  responsibilities  of  the  parties. 

j 

(2)  Hie  acronym  CD,  as  used  herein,  includes  that  which  son* 
users  would  perceive  as  “design  deficiencies”  but  excludes  deficiencies  which 
would  require  substantial  effort  to  develop  |>ortion8  of  the  product  design. 

(3)  Further  definition  of  the  word  “substantial”  as  a broad  or 
narrow  line  of  differentiation  would  depend  upon  conditions  peculiar  to  an 
individual  contract. 

| 

h.  F.CP’s  would  be  impossible  or  commercially  impracticable  to 
accomplish. 
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APPENDIX  It 

DEPARTMENT  OF  THE  ARMY 
UNITED  STATES  ARMY  LOGISTICS  MANAGEMENT  CENTER 
TORT  LEE.  VIRGINIA  SSSOI 

S-30  May  1972 

AMXMC-I.R-PRO  5 April  1972 

SUIIJKOT:  Project  IMPACT,  Technical  Data  Package  Improvement,  Pre-Production 
Evaluation  (PPE)  Study 


1.  Reference  teletype  dated  14  January  1972,  subject:  AMC  Improved  Management  of 
Procurement  and  Contracting  Techniques  (IMPACT)  Program  RCS  AMC.RP-l  13. 

2.  This  office  lias  lieen  tasked  to  conduct  a review  and  analysis  of  the  approaches  taken  hy 
each  Major  Subordinate  Command  (MSC),  and  selected  laboratories  and  IVoject 
Management  Offices  in  the  use  of  the  lYe-IVoduction  Evaluation  procedure  descrilied  in 
AMCP  715-6.  The  purpose  of  the  study  is  to  determine  the  degree  of  success  being  achieved 
in  the  use  of  the  PPE  approach.  Additional  objectives  are  to  determine  pitfalls  likely  to  he 
encountered  in  its  continued  use,  conditions  for  continued  use,  and  actions  necessary  by 
Headquarters  AMC  relative  to  standardization  of  the  concept. 

II.  To  assist  the  Army  Procurement  Research  Office  in  the  accomplishment  of  this  task, 
you  are  requested  to  submit  the  information  detailed  by  Inrtosuir  | to  tlie  following 
address  on  or  liefore  30  May  1 972: 

Director,  US  Army  Procia-ement  Research  Office 

US  Army  leptia  Management  Center 

ATTN:  AMXMC-I.R-PRO  (Mr.  Ken  Griffiths,  Project  Officer) 

Fort  lee,  Virginia  23801 
AllTOVON  687-6406. 

Any  questions  regarding  this  request  should  he  directed  to  the  APRO  Project  Officer 
identified  above. 
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AMXMC-I.R-PRO  r,  A|*ril  1972 

SUHJEOT:  Project  IMI’MT,  Tn*hnicil  Data  Package  Improvement,  Prr -Product  ion 
Evaluation  (PPM)  Study 

4.  (lease  provide  iw  with  a point  of  contact  within  the  organization  charged  with  the 
responsibility  for  accomplishing  this  task  as  soon  as  possilde. 

FOR  THE  COMMANDANT: 


s/R.  L Schooling 

I Incl  It  E.  SCHOOLING,  J.D. 

as  Director,  IIS  Army 

Procurement  Research  Office 
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A PRO  TASK  724 

Pro  product  ion  (.valuation  (AM(!P  715-6) 

Data  KJements  (Sidelines 

A.  Oneral  Information. 

1.  Thin  data  elements  guideline  acts  forth  the  desired  details  and  types  of 
commentaries  requested  from  your  organization.  A problem  statement  and  a functional 
definition  of  the  PPK  procedure  are  stated  in  paragraphs  It  and  V.  below.  Paragraphs  D and  K, 
contain,  respectively,  10  data  elements  related  to  the  general  organizational  aspects  of  PPK 
utilization  and  10  elements  related  to  the  specific  contract  experiences  of  your  organization. 

2.  'I'he  guidance  is  intended  to  suggest  rather  titan  constrain  the  typo  and  extent  of 
information  to  he  documented  d taring  your  local  analysis.  One  goal  of  the  AM( '.-wide  study 
is  lo  surface  all  relevant  and  important  aspects  that  may  affect  tlecisions  regarding  future 
AMC.  utilization  of  the  PPK.  procedure.  To  attain  this  goal,  a spirit  of  cooperation  is 
solicited. 

.'I.  Upon  receipt,  the  set  of  analyses  will  lie  assimilated  Ity  the  APRO,  analyzed 
further  in  an  attempt  lo  identify  similitudes,  anomalies,  differences  in  approach  and 
experience,  reasons  for  differences,  and  so  forth,  following  the  central  analysis  by  APRO,  a 
visit  may  lie  arranged  with  your  organization  lo  reconcile  and  clarify  any  differences  in 
understanding,  terminology,  and  viewpoints  that  may  exist  relating  to  PPK.. 

II.  Problem  Statement. 

I.  The  Teclinical  Data  Package  Problem  (Paraphrased  from  Kranklord  Arsenal 
Regulation  71 5-38). 

a.  Technical  Data  Packages  are  generally  intended  to  lie  suitable  for  unrestricted 
competitive  procurement.  However,  supply  contracts  for  production  of  military  design 
equipment  mission  items  of  moderate  to  high  complexity— especially  initial  production 
contracts— tend  to  he  characterized  hy  discrepancies,  errors,  or  deficiencies  in  the  technical 
data  which  may  preclude  practical  manufacture  or  assembly,  or  which  may  preclude  the 
attainment  of  required  performance  as  set  forth  in  the  item  specification. 
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b.  A substantial  number  of  rcHidual  error*,  omissions,  or  coni  ro  venial 
producihility  problem*  can  lie  expected  lo  remain  in  a new  Technical  Data  Package  even 
after  thorough  checking  by  competent  technical  personnel.  The  number  of  these  error*  or 
problem  areas  will  he  significantly  reduced  by  a carefully  controlled  prototype 
manufacturing  and  test  phase,  but  despite  all  practical  precautions,  a substantial  number  of 
mandatory  change*  may  lie  required  during  initial  jiroduction. 

c.  In  a competitive  environment,  the  certainly  of  engineering  changes  in  initial 
production  lends  In  encourage  “buying  in*'  on  a contract  by  bidder*  who  hope  to  “get  well” 
through  the  negotiation  of  these  numerous  changes.  The  possibility  of  getting  well  is 
enhanced  hy  the  noncompetitive  nature  of  the  negotiations  which  arc  often  conducted 
under  conditions  adverse  to  the  Government's  bargaining  position  because  of  the  alleged 
effect  of  the  accinnulaled  changes  on  contract  schedules. 

d.  When  otherwise  qualified  suppliers  intentionally  “buy  in”  on  a contract  with 
offers  and  bids  which  do  not  provide  a reasonable  margin  of  profit,  contract  administration 
problems  increase,  and  tfie  attainment  of  quality  and  timely  delivery  is  invariably  difficult. 
It  can  be  expected  that  the  contract  price  will  rapidly  escalate  as  the  contractor  attempts  to 
recover  his  losses  tlirough  the  changes  article  of  the  contract,  despite  the  best  efforts  of 
competent  Government  negotiators.  Delays  caused  by  the  introduction  of  engineering 
changes  liave  historically  been  one  of  the  more  serious  problem*  encountered  in  initial 
production  contracts.  Tlie  lime  consumed  in  obtaining  funds  and  in  negotiating  the  cost  of 
numerous  engineering  changes  often  results  in  continuing  invalidation  of  contract  schedules. 

2.  The  Preproduction  K valuation  Procedural  Problem. 

a.  The  basic  PPK  procedure  requires  the  contractor  immediately  after  award  to 
perform  a detailed  review  of  all  technical  data  furnished  under  the  contract  to  identify  any 
discrepancy,  error,  or  deficiency  in  the  technical  data  which  may  preclude  practical 
manufacture  or  assembly,  or  which  may  preclude  the  attainment  of  required  performance  as 
set  forth  in  tlie  Hem  specification,  litis  review  is  required  to  be  performed  prior  to,  or  in 
conjunction  with  his  process  planning,  tool  design,  development  of  inspection  plans  and 
procedires,  design  of  inspection  equipment,  and  throughout  the  production  and  inspection 
phase  of  the  contract. 

h.  A contract  containing  PPE  provisions  mually  provide*  for  the  introduction  of 
most  of  the  necessary  changes  withoiH  additional  cost  lo  the  Government,  and  without 
affecting  contract  delivery  schedules.  It  serves  to  discourage  the  practice  of  “buying  in"  on  a 
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contract,  ami  to  encourage  the  submission  of  proposals  by  the  most  qualified  ami  most 
quality-conscious  suppliers  who  otherwise  would  lie  subject  to  the  unfair  competition  of 
intentional  “loss-type''  offers  by  offerors  who  have  no  intention  of  meeting  their  price  and 
delivery  commitments. 

c.  Guidance  for  use  of  the  PPK  procedures,  however,  has  been  essentially  limited 
to  the  conceptual  type  discussion  contained  within  AMCP  7l.r>-6.  Separate  major 
suliordinate  commands,  lalioralories  and  project  managed  organizations  utilizing  the 
concept,  have  developed  differing  sets  of  specific  procedures  tailored  to  accommodate  local 
needs  and  interpretations. 

d.  The  differences  in  procedural  implementation  include  differing  names  of  the 
technique,  definitions  of  technical  terms,  criteria  for  use,  contract  provisions,  solicitation 
practices,  KCPand  KCO  dispositions,  pricing  techniques,  and  so  forth. 

e.  Additionally,  differing  views  prevail  with  respect  to  the  applicability  of  the 
procedure,  the  reasonableness  of  the  inherent  transfer  of  risk  to  contractors,  and  the  overall 
effectiveness  of  the  procedure. 

f.  At  this  time  throughout  the  AMC,  complex,  the  differing  viewpoints  and 
implementation  procedures  may  lie  acting  as  constraints  upon  the  full  exploitation  of  the 
potential  lienefits  or  to  perpetuate  impractical  methods  of  procirement.  The  question  from 
a Headquarters  point  of  view,  is  whether  use  of  the  PPK  procedure  should  be  continued  and 
if  so,  how. 

Definition.  Preproduction  F valuation  is  a procedure  used  in  firm  fixed-price  or 
fixed-price  incentive  production  contracts  in  which  the  contractor  is  required  to  conduct  a 
review  of  the  detailed  Technical  Data  Package  and,  thereafter,  certify  its  suitability  for  his 
use  in  complying  with  all  end  item  performance  requirements.  The  contractor’s  certification 
lakes  the  form  of  an  agreement  that  he  will  meet  tlic  end  items  performance  requirements 
after  compliance  with  any  revisions  found  necessary  during  his  review.  The  contractor  may 
depart  from  the  detail  technical  data  furnished  hy  the  Government  if  lie  can,  as  a result  of 
his  preproduction  evaluation  of  the  Technical  Data  Package,  demonstrate  an  incompatibility 
in  the  design  or  technical  data,  in  which  case  he  is  required  to  propose  the  appropriate 
corrective  action.  The  distinctive  feature  of  the  PPK  procediare  is  that  any  engineering 
clunge  which  may  lie  found  necessary  in  manufacture  or  assembly  to  enable  the  contractor 
to  meet  the  requirements  of  the  end  item  specification  must  be  accepted  without  additional 
cost  to  the  Government  and  without  delay  in  delivery;  i.e.,  without  recourse  to  the  changes 
article  of  the  contracts. 
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I).  I)at«  Klemont*  Relating  to  General  Organizational  Aspects. 

1.  A commentary  regarding  the  native  of  the  problem  at  each  organization  to 
determine  whether  normal  supply  contracts  (without  PPK,)  have  generally  experienced 
significant  cost  growth  and  schedule  delays  in  initial  production  of  new  material  due  to  the 
actual  or  alleged  effect  of  engineering  changes.  Kx  ample*,  facts,  and  estimates  applicable  to 
a few  selected  contracts  are  solicited;  the  degree  of  detail  to  he  included  in  the  response  is 
open  to  the  discretion  of  the  respondee. 

2.  A commentary  regarding  the  history  of  PPK  utilization  hy  the  organization. 

.'I.  A list  and  physical  attachment  of  the  local  policy  and  procedural  guidance 
documents  issued  by  the  organization  relative  to  the  PPK  process. 

4.  A commentary  regarding  the  steps  hy  which  the  organization  decides  to  use  the 
PPK  procedure  or  conversely  determines  not  to  use  it. 

5.  A commentary  regarding  the  rationale  for  nonuse  of  the  PPK  procedure,  if 
applicable.  Detailed  reasons  why  the  organization  has  decided' against  the  procedure  are 
solicited— i.e.,  if  tire  reason  is  sidrstantive.  If  the  reason  is  due  to  lack  of  emphasis  or 
guidance,  suggestions  are  solicited  to  enhance  it.  If  the  PPK,  concept  was  considered  for  use 
on  certain  contracts  but  decided  against,  the  reasons  for  the  decision  are  solicited. 

6.  A commentary  regarding  the  general  understanding  and  familiarity  of  the 
procurement  and  engineering  personnel  of  the  organization  with  the  PPK  concept— and  the 
ascribed  reasons  for  any  “low  level”  of  understanding,  e.g.,  a lack  of  emphasis  or  publicity. 

7.  A commentary  regarding  the  likelihood  or  probability  of  nonuse  or  continued 
utilization  of  the  PPK  procedure  under  appropriate  circumstances,  including  use  in  other 
llun  initial  production  contracts,  follow-on  production  contracts  placed  with  the  developer 
(via  the  “Certification  of  Technical  Data”  clause),  and  in  follow-on  competitive 

I procurements  of  the  same  item. 

8.  A commentary  regarding  special  problems  and  pitfalls  experienced  or  envisioned. 

9.  Suggestions  for  conditions  for  continued  use  hy  the  AMC  complex  and  for 
Ucadquartera,  AMC  standardization  of  the  procedire. 
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10.  Suggestions  for  the  improvement  of  the  PPK  concept,  the  Certification  of 
Technical  Data  Clause,  and  for  any  other  method  of  facilitating  the  transition  of 
development  items  to  production. 

E.  Data  Elements  Relating  to  Specific  Contracts. 

1.  A description  of  the  past  and  currently  open  contracts  which  contain  PPE 
provisions,  including  general  procurement  history,  contractors,  end  items,  number  of  items 
procured,  unit  price,  initial  contract  price,  contract  type,  manner  of  solicitation, 
presolicitation  conference,  pre-award  survey  concern  with  PPE,  general  acceptance  of  PPE 
by  offerors,  primary  objections  of  offerors,  etc. 

2.  A description  of  the  related  data  and  procedural  techniques  used  for  each  PPE 
type  contract,  including  “break  out”  of  PPE  price  as  a separate  line  item,  PPE  price 
expressed  as  a percentage  of  hardware  costs-or  a subjective  determination  of  PPE  costs  if 
not  separately  itemized,  sample  clause  used  (AMCP  715-6),  total  responsibility  coverage  as 
opposed  to  differentiation  between  responaibility  for  design  and  data  errors,  whether 
automatic  ECP  approval  provisions  were  included  and  the  specific  time  for  approval, 
differentiation  between  essential  and  nonessential  changes,  and  so  forth. 

3.  A description  of  the  results  of  each  PPE  type  contract,  including  total  number  of 
ECP’s  approved,  and  the  number  and  cost  of  Category  1 ECP’s  if  any. 

4.  An  estimate  of  the  cost  of  Category  II  changes  for  each  contract  as  compared 
with  the  probable  cost  of  the  same  changes  if  they  had  been  processed  under  the  changes 
article. 

5.  An  estimate  of  the  schedule  delays  for  each  contract  which  would  have  resulted 
from  Category  II  changes  if  they  had  been  implemented  under  the  changes  article. 

6.  A commentary  regarding  the  contract  administration  problems  of  each  PPE  type 
contract  including— 

a.  Reservations  of  Government  technical  personnel  as  to  their  abilities  to  carry 
out  their  responsibilities  such  as  ECP  disposition  and  surveillance  of  PPE  concepts. 

b.  TDP  maintenance  and  drawing  revision  problems. 
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c.  Port  award  contractor  claim*  and  an  estimate  of  the  justification  or  lack 

thereof. 

d.  Claims  of  “impossibility  of  performance”  along  with  an  assessment  of  the 
justification. 

7.  A commentary  regarding  the  reasonableness  of  the  allocation  of  riA  in  each  PPE 
contract  to  both  the  contractor  and  the  Government. 

8.  A commentary  regarding  the  relative  degree  of  Government-contractor 
cooperation  and  whether  or  not  use  of  the  PPE  procedure  helped  in  the  subject  contract  to 
reduce  the  adversary  relationship  common  in  supply  contracts. 

■> 

9.  A commentary  regarding  the  quality  of  the  selected  contractor,  including  an 
assessment  of  whether  the  PPE  procedure  encouraged  the  participation  of  a more 
responsible  contractor,  and  whether  it  enhanced  the  selection  of  a better  source  in  the 
subject  contract. 

10.  A commentary  regarding  the  overall  degree  of  success  of  the  use  of  PPE 
provisions  in  the  contract— i.e.,  whether  it  resulted  in  “out-of-contract”  savings  in  time  and 
money  in  the  Government’s  administration  of  the  contract,  exclusive  of  the  estimated 
“in-contract”  savings  by  introducing  ECFs  into  production  without  additional  cost. 
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